-- Logs begin at Wed 2022-08-10 16:15:33 UTC, end at Wed 2022-08-10 17:36:39 UTC. -- Aug 10 17:05:25.821584 dv-cinder-852724-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 17:05:25.831128 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 17:05:25.833103 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 17:05:25 2022] *** Aug 10 17:05:25.833103 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 17:05:25.833103 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 17:05:25.833103 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: nodename: dv-cinder-852724-3-iscsi Aug 10 17:05:25.833103 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: machine: x86_64 Aug 10 17:05:25.833103 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: clock source: unix Aug 10 17:05:25.833103 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: pcre jit disabled Aug 10 17:05:25.833103 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: detected number of CPU cores: 4 Aug 10 17:05:25.833103 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: current working directory: / Aug 10 17:05:25.833103 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: detected binary path: /usr/bin/uwsgi-core Aug 10 17:05:25.833705 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: your processes number limit is 47680 Aug 10 17:05:25.833705 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: your memory page size is 4096 bytes Aug 10 17:05:25.833705 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: detected max file descriptor number: 2048 Aug 10 17:05:25.833705 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: lock engine: pthread robust mutexes Aug 10 17:05:25.833705 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: thunder lock: enabled Aug 10 17:05:25.833705 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 17:05:25.833705 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 17:05:25.872638 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: Python main interpreter initialized at 0x562b6270f9c0 Aug 10 17:05:25.872638 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: python threads support enabled Aug 10 17:05:25.872638 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: your server socket listen backlog is limited to 100 connections Aug 10 17:05:25.872638 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: your mercy for graceful operations on workers is 90 seconds Aug 10 17:05:25.872991 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 17:05:25.872991 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: *** Operational MODE: preforking *** Aug 10 17:05:25.873236 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: *** uWSGI is running in multiple interpreter mode *** Aug 10 17:05:25.873236 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: spawned uWSGI master process (pid: 106110) Aug 10 17:05:25.873467 dv-cinder-852724-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 17:05:25.874233 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: spawned uWSGI worker 1 (pid: 106111, cores: 1) Aug 10 17:05:25.874341 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: spawned uWSGI worker 2 (pid: 106112, cores: 1) Aug 10 17:05:25.874528 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 17:05:26.548769 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 17:05:26.549371 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 17:05:27.647406 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:05:27.647406 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: from cryptography.utils import int_from_bytes Aug 10 17:05:27.647937 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:05:27.647937 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: from cryptography.utils import int_from_bytes Aug 10 17:05:27.649807 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:05:27.649807 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: from cryptography.utils import int_from_bytes Aug 10 17:05:27.650229 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:05:27.650229 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: from cryptography.utils import int_from_bytes Aug 10 17:05:30.146899 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 17:05:30.147558 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 17:05:30.147659 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 17:05:30.147659 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 17:05:30.148053 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 17:05:30.148053 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 17:05:30.148187 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 17:05:30.148323 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 17:05:30.148445 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 17:05:30.148683 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.148807 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 17:05:30.148967 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.149145 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.149295 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.149478 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.149628 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.149811 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.149956 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.150141 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.150272 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.150500 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.150624 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.150818 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.150947 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.151140 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.151280 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.151462 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.151557 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.151795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.151893 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.152058 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.152178 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852724-3-iscsi {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.152377 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.152506 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.152704 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852724-3-iscsi {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.152803 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.153028 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.153124 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.153340 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.153427 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.153652 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.153741 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.153975 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.154111 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.154284 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.154413 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.154683 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.154995 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.155137 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.155445 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.155558 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.155764 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.155866 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.156085 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.156178 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.156444 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.156556 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.156782 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.156889 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.157102 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.157196 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.157417 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.157520 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.157737 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.157831 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.158049 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.158149 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.158388 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.158497 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.158696 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.158789 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852724-3-iscsi {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.159102 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852724-3-iscsi {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.159209 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.159419 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.159504 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.159733 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.159843 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.160059 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.160157 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.160455 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.160560 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.160772 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.160857 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.161082 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.161180 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.161409 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.161514 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.161726 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.161818 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.162038 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.162123 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.162384 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.162472 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.162712 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.162797 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.163036 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.163124 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.163361 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.163456 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.163667 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.163752 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.163978 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.164090 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.164290 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.164382 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.164597 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.164689 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.164908 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.164997 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.165161 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.165255 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.165452 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.165546 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.165764 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.165857 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.166088 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.166174 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.166434 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.166522 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.166691 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.166867 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.166952 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.167031 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.167244 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.167329 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.167567 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.167653 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.167880 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.167965 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.168189 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.168282 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.168499 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.168599 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.168810 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.168902 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.169116 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.169215 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.169425 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.169508 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.169734 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.169818 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.170052 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.170196 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.170393 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.170480 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.170722 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.170809 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.171040 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.171132 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.171351 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.171445 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.171666 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.171761 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.171987 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.172089 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.172311 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.172395 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.172623 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.172718 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.172933 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.173030 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.173276 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.173362 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.173591 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.173683 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.173895 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.173980 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.174216 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.174301 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.174565 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.174658 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.174877 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.174964 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.175188 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.175271 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.175497 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.175580 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.175820 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.175907 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.176135 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.176219 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.176389 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.176484 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.176694 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.176787 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.177000 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.177085 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.177311 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.177406 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.177619 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.177713 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.177929 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.178025 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.178237 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.178330 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.178569 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.178657 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.178868 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.178969 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.179177 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.179277 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.179485 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.179569 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.179795 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.179887 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.180104 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.180201 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.180412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.180499 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.180718 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.180809 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.181081 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.181187 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.181334 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.181419 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.181643 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.181744 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.181966 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.182053 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.182273 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.182386 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.182610 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.182695 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.182918 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.183006 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.183226 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.183320 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.183533 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.183618 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.183847 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.183941 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.184155 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.184241 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.184464 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.184554 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.184774 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.184867 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.185083 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.185176 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.185390 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.185493 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.185704 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.185795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.186574 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.186660 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.186890 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.186984 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.187213 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.187301 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.187519 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.187604 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.187830 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.187915 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.188152 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.188239 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.188459 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.188545 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.188766 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.188863 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.189071 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.189155 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.189376 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.189459 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.189684 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.189791 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.189990 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.190077 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.190293 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.190530 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.190617 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.190705 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.190917 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.191011 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.191239 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.191325 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.191558 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.191654 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.191869 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.191955 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.192179 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.192265 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.192485 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.192561 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.192806 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:05:30.192881 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.193150 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.193225 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.193486 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.193574 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.193802 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.193878 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.194134 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.194208 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.194493 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.194576 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.194822 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.194905 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.195138 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.195221 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.195458 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.195534 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.195788 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.195870 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.196106 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.196190 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.196423 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.196499 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.196735 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.196816 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.197049 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.197137 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.197369 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.197464 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.197687 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.197785 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.198009 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.198101 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.198326 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.198443 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.198666 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.198759 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.198979 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.199074 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.199290 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.199374 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.199611 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.199700 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.199936 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.200031 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.200250 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.200336 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.200631 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.200728 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.200899 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.201001 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.201237 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.201323 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.202113 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.202212 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.202480 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.202584 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.202812 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.202900 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.203133 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.203221 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.203449 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.203544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.203766 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.203853 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.204094 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.204180 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.204434 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.204528 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.204752 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.204846 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.205078 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.205172 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.205395 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.205481 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.205711 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.205802 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.206025 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.206123 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.206340 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.206458 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.206682 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.206768 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.207016 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.207109 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.207335 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.207420 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.207650 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.207742 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.207965 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.208062 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.208281 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.208430 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.208596 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.208682 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.208911 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.209005 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.209223 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.209309 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.209529 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.209676 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.209838 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.209926 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.210142 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.210227 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.210475 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.210566 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.210791 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.210917 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.211113 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.211196 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.211429 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.211506 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.211739 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.211835 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.212066 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.212150 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.212372 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.212448 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.212688 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.212766 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.213001 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.213079 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.213320 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.213419 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.213624 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.213734 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.213939 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.214047 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.214251 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.214382 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.214585 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.214684 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.214910 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.215006 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.215225 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.215331 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.215536 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.215635 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.215851 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.215948 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.216159 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.216264 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.216470 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.216568 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.216783 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.216903 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.217123 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.217226 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.217440 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.217539 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.217757 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.218001 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.218182 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.218337 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.218457 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.218683 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.218776 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.219005 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.219103 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.219345 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.219433 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.219687 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.219865 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.220014 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.220167 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.220304 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.220440 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.220623 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.220778 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.221010 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.221145 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.221282 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.221424 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.221597 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.221737 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.221887 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.222024 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.222161 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.222295 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.222459 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.222600 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.222744 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.222880 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.223050 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.223190 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.223359 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.223500 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.223666 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.223803 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.223975 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.224118 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.224281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.224428 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.224606 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.224741 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.224917 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.225051 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.225224 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.225368 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.225518 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.225657 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.225827 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.225957 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.226174 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.226323 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.226512 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.226644 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.226861 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.227011 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.227205 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.227310 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.227532 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.227621 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.227862 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.227949 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.228179 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.228265 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.228499 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.228585 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.228813 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.228898 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.229129 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.229227 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.229444 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.229529 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.229760 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.229889 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.230083 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.230170 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.230420 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.230521 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.230746 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.230838 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.231065 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.231174 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.231392 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.231491 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.231708 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.231806 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.232033 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.232129 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.232341 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.232438 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.232684 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.232858 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.233030 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.233248 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.233404 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.233594 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.233804 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.233923 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.234136 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.234253 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.234478 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.234601 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.234801 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.234924 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.235119 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.235241 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.235438 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.235559 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.235756 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.235877 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.236073 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.236195 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.236673 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.236776 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.236857 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.236926 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.237026 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.237138 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.237341 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.237455 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.237720 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.237820 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.237979 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.238087 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.238304 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.238436 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.238637 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.238750 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.238957 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.239070 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.239294 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.239404 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.239702 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.239820 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.239949 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.240038 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.240246 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.240343 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.240571 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.240659 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.240884 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.240971 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.241198 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.241311 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.241511 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.241619 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.241822 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.241917 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.242131 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.242226 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.242472 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.242612 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.242787 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.242890 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.243097 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.243197 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.243410 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.243503 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.243716 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.243802 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.244032 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.244132 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.244342 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.244440 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.244648 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.244733 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.244953 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.245039 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.245267 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.245360 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.245595 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.245713 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.245907 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.246035 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.246230 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.246411 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.246579 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.246734 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.246888 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.247011 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.247198 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.247322 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.247524 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.247648 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.247885 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.247975 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.248133 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.248260 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.248982 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.249290 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.249380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.249694 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.249787 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.250015 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.250101 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.250332 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.250456 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.250677 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.250780 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.250999 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.251085 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.251315 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.251413 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.251633 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.251718 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.251945 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.252038 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.252261 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.252348 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.252576 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.252661 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.252891 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.252985 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.253205 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.253292 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.253518 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.253607 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.253831 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.253928 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.254144 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.254229 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.254484 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.254572 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.254801 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.254899 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.255114 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.255222 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.255435 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.255555 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.255747 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.255851 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.256053 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.256144 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.256358 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.256462 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.256675 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.256793 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.256998 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.257265 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.257574 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.257682 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.257919 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.258028 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.258236 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.258325 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.258590 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.258686 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.258917 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.259008 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.259251 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.259341 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.259586 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.259676 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.259922 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.260012 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.260245 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.260354 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.260558 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.260658 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.260868 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.260958 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.261181 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.261344 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.261493 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.261586 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.261805 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.261895 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.262116 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.262204 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.262448 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.262551 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.262759 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.262844 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.263065 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.263152 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.263374 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.263460 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.263677 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.263771 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.264036 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.264672 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.264855 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.265111 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.265210 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.265403 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.265500 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.265720 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.265806 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.266043 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.266140 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.266374 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.266464 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.266685 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.266770 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.266995 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.267132 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.267303 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.267392 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.267648 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.267734 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.268213 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.268325 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.268547 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.268674 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.268858 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.268944 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.269204 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.269301 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.269510 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.269595 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.269820 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.269906 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.270152 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.270248 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.270485 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.270577 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.270795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.270889 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.271104 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.271204 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.271412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.271534 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.271721 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.271814 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.272027 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.272113 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.272342 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.272428 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.272650 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.272734 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.272959 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.273052 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.273271 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.273357 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.273578 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.273664 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.273890 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.273977 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.274193 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.274285 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.274532 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.274619 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.274841 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.274928 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.275147 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.275232 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.275452 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.275547 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.275757 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.275842 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.276066 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.276157 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.276372 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.276465 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.276685 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.276770 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.276990 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.277074 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.277302 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.277396 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.277609 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.277694 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.277939 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.278032 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.278250 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.278410 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.278590 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.278691 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.278900 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.278986 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.279205 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.279291 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.279669 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.279888 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.279972 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.280042 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.280198 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.280340 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.280508 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.280659 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.280791 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.280927 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.281070 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.281202 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.281369 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.281519 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.281679 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.281776 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.281989 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.282084 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.282310 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.282417 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.282664 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.282762 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.282976 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.283061 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.283286 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.283377 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.283591 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.283685 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.283901 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.283994 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.284236 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.284339 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.284516 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.284616 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.284830 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.284917 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.285138 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.285233 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.285444 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.285538 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.285749 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.285841 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.286057 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.286143 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.286384 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.286501 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.286697 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.286814 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.287009 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.287109 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.287316 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.287414 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.287626 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.287725 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.287933 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.288039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.288280 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.288426 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.288589 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.288674 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.288908 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.289003 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.289229 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.289316 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.289662 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.289763 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.289889 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.289984 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.290212 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.290299 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.290546 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.290633 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.290867 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.290965 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.291183 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.291270 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.291501 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.291632 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.291809 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.291912 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.292117 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.292211 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.292423 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.292508 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.292732 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.292828 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.293045 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.293130 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.293362 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.293447 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.293680 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.293783 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.294002 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.294090 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.294311 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.294455 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.294649 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.294737 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.294959 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.295049 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.295812 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.296079 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.296175 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.296408 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.296496 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.296728 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.296814 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.297040 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.297135 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.297357 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.297442 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.297669 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.297754 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.297985 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.298081 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.298295 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.298401 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.298652 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.298748 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.298967 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.299056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.299276 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.299362 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.299603 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.299688 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.299917 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.300003 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.300226 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.300312 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.300541 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.300628 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.300855 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.300943 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.301164 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.301248 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.301468 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.301552 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.301781 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.301907 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.302098 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.302227 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.302433 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.302570 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.302881 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.302977 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.303195 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.303280 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.303509 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.303676 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.303822 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.303909 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.304138 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.304223 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.304450 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.304545 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.304794 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.304880 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.305115 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.305201 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.305426 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.305521 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.305796 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.305881 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.306104 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.306196 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.306441 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.306530 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.306760 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.306846 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.307086 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.307174 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.307395 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.307481 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.307699 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.307785 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.308006 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.308092 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.308322 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.308409 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.308628 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.308712 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.308934 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.309019 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.309260 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.309356 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.309571 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.309659 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.309897 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.309991 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.310317 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.310422 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.310666 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.310752 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.311518 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.311628 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.311942 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.312031 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.312260 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.312354 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.312577 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.312672 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.312910 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.312996 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.313239 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.313325 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.313555 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.313650 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.313864 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.313959 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.314181 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.314268 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.314520 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.314619 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.314840 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.315005 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.315147 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.315242 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.315471 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.315557 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.315792 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.315880 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.316101 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.316187 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.316450 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.316546 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.316821 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.316909 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.317142 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.317229 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.317470 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.317553 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.317794 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.317880 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.318123 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.318210 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.318468 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.318579 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.318771 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.318891 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.319085 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.319218 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.319395 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.319533 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.319704 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.319845 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.320031 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.320161 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.320341 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.320472 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.320661 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.320784 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.320978 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.321113 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.321292 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.321490 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.321605 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.321813 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.321941 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.322131 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.322221 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.322472 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.322576 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.322793 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.322882 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.323104 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.323205 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.323432 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.323519 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.323743 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.323831 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.324069 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.324168 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.324388 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.324488 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.324706 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.324801 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.325014 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.325124 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.325322 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.325417 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.325633 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.325725 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.325950 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.326071 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.326261 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.326409 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.326784 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.326884 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.327103 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.327201 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.327479 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.327591 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.327795 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.327894 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.328124 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.328292 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.328548 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.328690 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.328891 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.328994 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.329211 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.329300 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.329551 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.329651 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.329885 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.329984 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.330216 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.330324 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.330552 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.330642 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.330869 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.330978 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.331185 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.331274 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.331497 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.331586 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.331809 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.331908 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.332119 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.332226 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.332426 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.332523 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.332740 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.332837 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.333053 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.333155 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.333361 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.333450 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.333672 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.333772 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.333981 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.334070 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.334306 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.334417 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.334667 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.334773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.334946 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.335044 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.335264 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.335360 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.335571 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.335663 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.335883 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.335971 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.336191 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.336281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.336520 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.336610 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.336834 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.336921 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.337151 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.337252 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.337472 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.337561 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.337793 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.337891 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.338112 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.338209 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.338455 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.338549 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.338780 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.338875 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.339093 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.339203 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.339412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.339500 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.339727 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.339815 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.340046 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.340142 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.340365 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.340587 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.340678 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.340929 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.341027 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.341247 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.341338 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.341565 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.341819 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.341916 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.342257 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.342804 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.343129 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.343218 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.343448 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.343537 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.343765 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.343856 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.344082 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.344171 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.344418 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.344520 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.344750 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.344868 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.345106 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.345213 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.345448 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.345679 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.345815 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.345953 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.346099 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.346235 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.346399 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.346552 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.346715 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.346896 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.347077 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.347230 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.347398 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.347576 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.347710 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.347905 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.348033 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.348231 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.348333 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.348555 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.348643 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.348880 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.348967 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.349234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.349327 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.349550 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.349636 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.349863 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.349957 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.350175 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.350262 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.350511 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.350602 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.350832 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.350919 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.351150 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.351237 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.351467 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.351560 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.351790 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.351894 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.352109 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.352219 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.352454 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.352539 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.352734 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.352863 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.353052 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.353142 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.353373 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.353592 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.353711 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.353915 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.354052 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.354254 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.354427 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.354609 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.354754 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.354943 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.355099 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.355262 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.355394 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.355584 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.355915 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.356045 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.356226 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.356366 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.356535 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.356674 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.356851 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.356982 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.357163 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.357254 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.357470 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.358227 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.358336 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.358601 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.358733 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.358947 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.359045 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.359263 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.359353 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.359580 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.359675 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.359900 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.360192 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.360295 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.360520 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.360653 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.360851 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.360939 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.361170 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.361266 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.361484 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.361572 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.361814 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.361902 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.362124 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.362223 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.362488 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.362719 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.362808 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.363080 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.363177 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.363407 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.363492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.363725 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.363811 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.364034 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.364129 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.364343 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.364437 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.364660 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.364749 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.364978 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.365112 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.365288 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.365376 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.365601 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.365689 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.365910 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.366007 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.366231 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.366316 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.366568 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.366654 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.366879 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.366966 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.367186 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.367272 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.367502 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.367587 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.367812 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.367899 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.368124 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.368218 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.368434 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.368528 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.368743 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.368841 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.369060 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.369147 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.369369 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.369455 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.369679 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.369766 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.369986 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.370073 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.370296 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.370413 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.370627 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.370759 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.370940 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.371027 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.371251 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.371347 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.371569 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.371657 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.371875 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.371961 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.372189 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.372289 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.372504 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.372637 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.372825 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.372973 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.373133 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.373324 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.374025 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.374197 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.374342 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.374474 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.374665 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.374755 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.374977 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.375064 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.375342 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.375627 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.375724 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.375969 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.376054 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.376291 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.376378 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.376610 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.376777 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.376930 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.377026 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.377260 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.377348 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.377572 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.377672 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.377884 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.378150 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.378238 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.378515 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.378623 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.378843 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.378931 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.379157 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.379242 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.379473 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.379569 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.379788 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.379876 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.380102 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.380189 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.380412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.380514 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.380725 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.380850 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.381038 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.381125 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.381353 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.381448 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.381664 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.381749 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.381977 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.382070 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.382286 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.382410 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.382631 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.382748 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.382949 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.383050 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.383267 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.383376 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.383582 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.383681 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.383901 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.384001 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.384216 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.384323 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.384529 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.384626 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.384842 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.384949 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.385155 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.385275 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.385468 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.385572 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.385780 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.385879 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.386099 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.386188 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.386452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.386542 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.386770 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.386876 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.387081 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.387172 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.387395 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.387512 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.387712 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.387831 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.388024 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.388154 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.388339 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.388478 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.388660 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.388793 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.389029 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.389221 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.389344 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.389472 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.389656 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.389788 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.390088 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.390184 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.390430 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.390533 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.390758 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.390853 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.391088 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.391184 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.391403 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.391500 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.391730 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.391818 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.392042 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.392128 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.392352 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.392448 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.392660 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.392769 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.393265 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.393358 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.393548 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.393637 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.393862 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.393950 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.394171 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.394257 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.394502 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.394592 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.394818 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.394914 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.395123 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.395210 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.395433 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.395522 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.395742 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.395837 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.396050 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.396137 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.396361 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.396450 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.396666 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.396753 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.397020 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.397123 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.397278 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.397365 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.397585 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.397672 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.397889 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.397983 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.398197 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.398292 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.398534 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.398625 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.398840 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.398934 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.399147 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.399286 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.399454 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.399549 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.399761 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.399862 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.400066 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.400152 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.400372 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.400459 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.400681 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.400776 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.400996 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.401128 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.401308 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.401396 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.401633 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.401730 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.401929 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.402017 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.402237 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.402324 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.402575 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.402668 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.402915 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.403001 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.403247 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.403373 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.403559 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.403661 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.403890 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.403981 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.404203 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.404301 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.404524 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.404679 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.404865 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.405095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.405194 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.405288 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.405507 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.405738 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.405841 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.406058 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.406147 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.406420 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.406518 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.406757 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.406859 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.407070 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.407174 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.407398 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.407487 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.407715 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.407812 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.408032 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.408130 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.408350 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.408448 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.408666 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.408755 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.409000 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.409103 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.409310 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.409406 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.409625 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.409713 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.409940 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.410037 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.410256 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.410345 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.410597 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.410688 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.410913 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.411004 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.411224 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.411314 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.411547 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.411644 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.411863 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.411961 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.412178 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.412274 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.412495 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.412597 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.412811 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.412951 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.413124 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.413212 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.413437 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.413541 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.413763 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.413872 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.414086 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.414176 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.414431 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.414543 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.414767 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.414858 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.415102 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.415272 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.415423 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.415579 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.415716 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.415816 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.416010 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.416145 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.416290 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 17:05:30.416435 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.416695 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.417045 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.417379 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.417698 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.418015 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.418323 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:05:30.418604 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 17:05:30.571614 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO dbcounter [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Registered counter for database nova_api Aug 10 17:05:30.574132 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO dbcounter [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] Registered counter for database nova_api Aug 10 17:05:30.593925 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_db.sqlalchemy.engines [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:05:30.597087 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG oslo_db.sqlalchemy.engines [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:05:30.600647 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG dbcounter [-] [106111] Writer thread running {{(pid=106111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:05:30.603912 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG dbcounter [-] [106112] Writer thread running {{(pid=106112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:05:30.658230 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.context [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),180adeb5-bada-47d6-898d-063cb32f2e64(cell1) {{(pid=106111) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 17:05:30.660794 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.context [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),180adeb5-bada-47d6-898d-063cb32f2e64(cell1) {{(pid=106112) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 17:05:30.662024 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:30.662537 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:30.664123 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:30.664635 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG oslo_concurrency.lockutils [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:30.664861 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:30.665110 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG oslo_concurrency.lockutils [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:30.665307 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:30.666697 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG oslo_concurrency.lockutils [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:30.667364 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:30.667504 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG oslo_concurrency.lockutils [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:05:30.667840 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG oslo_concurrency.lockutils [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:05:30.669372 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO dbcounter [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Registered counter for database nova_cell0 Aug 10 17:05:30.669834 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG oslo_concurrency.lockutils [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:05:30.672703 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO dbcounter [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] Registered counter for database nova_cell0 Aug 10 17:05:30.675678 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO dbcounter [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Registered counter for database nova_cell1 Aug 10 17:05:30.678477 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO dbcounter [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] Registered counter for database nova_cell1 Aug 10 17:05:30.684068 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_db.sqlalchemy.engines [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:05:30.685199 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_db.sqlalchemy.engines [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:05:30.687894 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG oslo_db.sqlalchemy.engines [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:05:30.690024 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG oslo_db.sqlalchemy.engines [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:05:30.692653 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG dbcounter [-] [106111] Writer thread running {{(pid=106111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:05:30.694129 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG dbcounter [-] [106111] Writer thread running {{(pid=106111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:05:30.697055 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG dbcounter [-] [106112] Writer thread running {{(pid=106112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:05:30.698796 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG dbcounter [-] [106112] Writer thread running {{(pid=106112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:05:30.839623 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO dbcounter [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Registered counter for database nova_cell0 Aug 10 17:05:30.849363 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_db.sqlalchemy.engines [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:05:30.850293 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO dbcounter [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] Registered counter for database nova_cell0 Aug 10 17:05:30.853946 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG dbcounter [-] [106111] Writer thread running {{(pid=106111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:05:30.859932 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG oslo_db.sqlalchemy.engines [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:05:30.864302 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG dbcounter [-] [106112] Writer thread running {{(pid=106112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:05:31.303460 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: WARNING keystonemiddleware.auth_token [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:05:31.311482 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: WARNING keystonemiddleware.auth_token [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:05:31.324158 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: WARNING keystonemiddleware.auth_token [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:05:31.332922 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: WARNING keystonemiddleware.auth_token [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:05:31.665530 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: WARNING keystonemiddleware.auth_token [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:05:31.672308 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: WARNING keystonemiddleware.auth_token [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:05:31.677543 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562b6270f9c0 pid: 106111 (default app) Aug 10 17:05:31.679640 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:05:31.680839 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001744 Aug 10 17:05:31.681248 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Wed Aug 10 17:05:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:05:31.691038 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: WARNING keystonemiddleware.auth_token [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:05:31.697049 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: WARNING keystonemiddleware.auth_token [None req-1dc5bb7b-09fa-440d-a38c-1eceef130bc7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:05:31.702955 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562b6270f9c0 pid: 106112 (default app) Aug 10 17:06:52.649958 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:52.651039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 10 17:06:52.651445 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 17:06:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:06:52.663820 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG dbcounter [-] [106112] Writing DB stats nova_api:SELECT=3 {{(pid=106112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:52.664656 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG dbcounter [-] [106112] Writing DB stats nova_cell1:SELECT=3 {{(pid=106112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:52.665937 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG dbcounter [-] [106112] Writing DB stats nova_cell0:SELECT=3 {{(pid=106112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:52.666986 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG dbcounter [-] [106112] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:53.555094 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-885820f2-4eed-4001-8df9-eee65fd86c50 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:53.588666 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-885820f2-4eed-4001-8df9-eee65fd86c50 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.930021 Aug 10 17:06:53.589784 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 10 17:06:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:55.898478 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:55.899780 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-25f2a859-343d-4546-878d-89c899b52a18 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 Aug 10 17:06:55.900784 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 17:06:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:06:56.466468 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-d7f5b527-24ca-4f7e-84c9-33f0ad8714cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "disk": 1, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:06:56.492262 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:06:56.492262 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: warnings.warn(msg) Aug 10 17:06:56.599056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-d7f5b527-24ca-4f7e-84c9-33f0ad8714cd admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.688311 Aug 10 17:06:56.600215 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 17:06:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 17:06:56.826554 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-1048c9db-b58a-40d6-836b-b082442583a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:06:56.831036 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:06:56.831036 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: warnings.warn(msg) Aug 10 17:06:56.851834 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG dbcounter [-] [106111] Writing DB stats nova_api:SELECT=3 {{(pid=106111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:56.852916 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG dbcounter [-] [106111] Writing DB stats nova_cell0:SELECT=3 {{(pid=106111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:56.853804 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG dbcounter [-] [106111] Writing DB stats nova_cell1:SELECT=3 {{(pid=106111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:56.854997 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG dbcounter [-] [106111] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:56.977581 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-1048c9db-b58a-40d6-836b-b082442583a4 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.367329 Aug 10 17:06:56.978907 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 10 17:06:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:06:59.252188 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-d7f5b527-24ca-4f7e-84c9-33f0ad8714cd admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:06:59.253831 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-d7f5b527-24ca-4f7e-84c9-33f0ad8714cd admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Aug 10 17:06:59.254835 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 17:06:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:06:59.952200 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-ba00509c-05aa-4e1f-85bc-09a6c784d5c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "name": "ds512M"}} {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:06:59.973441 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:06:59.973441 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: warnings.warn(msg) Aug 10 17:07:00.070600 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-ba00509c-05aa-4e1f-85bc-09a6c784d5c6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.809004 Aug 10 17:07:00.071543 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 17:06:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:07:00.083737 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-378bdb54-d185-429b-a996-30344e4314fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:00.086581 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:07:00.086581 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: warnings.warn(msg) Aug 10 17:07:00.211465 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-378bdb54-d185-429b-a996-30344e4314fc admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131426 Aug 10 17:07:00.212281 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 10 17:07:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:07:02.500898 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-ba00509c-05aa-4e1f-85bc-09a6c784d5c6 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:02.502101 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-ba00509c-05aa-4e1f-85bc-09a6c784d5c6 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001673 Aug 10 17:07:02.502537 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 17:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:02.915288 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-73724c70-9540-44e0-9bed-008b7f6b3c84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:02.992906 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-73724c70-9540-44e0-9bed-008b7f6b3c84 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.483929 Aug 10 17:07:02.993487 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 17:07:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:07:03.006181 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-37cb82fa-b247-4baa-847a-1167d523c4cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:03.095619 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-37cb82fa-b247-4baa-847a-1167d523c4cf admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093133 Aug 10 17:07:03.096357 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 10 17:07:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:05.507915 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-73724c70-9540-44e0-9bed-008b7f6b3c84 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:05.508953 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-73724c70-9540-44e0-9bed-008b7f6b3c84 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 10 17:07:05.509550 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 17:07:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:06.002081 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-fae9b9be-c525-4b45-853d-04d10ed37c10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:06.086078 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-fae9b9be-c525-4b45-853d-04d10ed37c10 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.569925 Aug 10 17:07:06.086808 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 17:07:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:07:06.099423 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-5989ad51-f113-4f5d-95a7-d3ce251da7aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:06.182280 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-5989ad51-f113-4f5d-95a7-d3ce251da7aa admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086442 Aug 10 17:07:06.192236 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 10 17:07:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:08.442294 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-fae9b9be-c525-4b45-853d-04d10ed37c10 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:08.443293 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-fae9b9be-c525-4b45-853d-04d10ed37c10 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 10 17:07:08.443695 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 17:07:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:08.896222 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-86652b3f-f913-458e-a62b-2b31beeaaa3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "id": "d4", "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096}} {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:08.977071 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-86652b3f-f913-458e-a62b-2b31beeaaa3c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.526767 Aug 10 17:07:08.978026 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 17:07:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:07:08.990879 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-f9f43a95-af52-48ce-8d17-4c629a527e31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:09.091194 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-f9f43a95-af52-48ce-8d17-4c629a527e31 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103204 Aug 10 17:07:09.097975 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 10 17:07:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:11.362119 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-86652b3f-f913-458e-a62b-2b31beeaaa3c admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:11.363101 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-86652b3f-f913-458e-a62b-2b31beeaaa3c admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 10 17:07:11.363508 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 17:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:11.899862 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-e84a6600-645c-49e7-8438-0786249b194c admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:11.927004 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-e84a6600-645c-49e7-8438-0786249b194c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.556814 Aug 10 17:07:11.927506 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 10 17:07:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:07:14.180866 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-86652b3f-f913-458e-a62b-2b31beeaaa3c admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:14.182343 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-86652b3f-f913-458e-a62b-2b31beeaaa3c admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002088 Aug 10 17:07:14.182966 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 17:07:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:14.624291 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-08d34b36-8378-47f0-95d9-9d92b92bef54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "id": "1"}} {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:14.730192 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-08d34b36-8378-47f0-95d9-9d92b92bef54 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.539468 Aug 10 17:07:14.731264 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 17:07:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:07:14.748837 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-25f3077c-1f31-4334-9150-fc13af8ef498 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:14.838252 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-25f3077c-1f31-4334-9150-fc13af8ef498 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095772 Aug 10 17:07:14.839211 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 10 17:07:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:17.056727 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-08d34b36-8378-47f0-95d9-9d92b92bef54 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:17.057853 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-08d34b36-8378-47f0-95d9-9d92b92bef54 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Aug 10 17:07:17.058499 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 17:07:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:17.469437 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-286f7c45-7e3e-4c60-b46c-ff47ed9717c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 1, "name": "m1.small", "ram": 2048}} {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:17.548642 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-286f7c45-7e3e-4c60-b46c-ff47ed9717c1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.483348 Aug 10 17:07:17.549113 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 17:07:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 17:07:17.562418 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-5d1294d8-1a8a-4c5e-a45c-278427de1941 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:17.650069 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-5d1294d8-1a8a-4c5e-a45c-278427de1941 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092440 Aug 10 17:07:17.650944 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 10 17:07:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:07:19.898897 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-286f7c45-7e3e-4c60-b46c-ff47ed9717c1 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:19.899919 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-286f7c45-7e3e-4c60-b46c-ff47ed9717c1 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 10 17:07:19.900450 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 17:07:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:20.283478 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-eec1f72a-e8c3-4c36-a63a-f5fe5042a7ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "name": "m1.medium"}} {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:20.377701 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-eec1f72a-e8c3-4c36-a63a-f5fe5042a7ab admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.469143 Aug 10 17:07:20.377701 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 17:07:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:07:20.390083 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-eb029643-cf33-48dc-959a-c752d3b0d37d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:20.501535 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-eb029643-cf33-48dc-959a-c752d3b0d37d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115751 Aug 10 17:07:20.502123 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 10 17:07:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:22.758892 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-eec1f72a-e8c3-4c36-a63a-f5fe5042a7ab admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:22.760872 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-eec1f72a-e8c3-4c36-a63a-f5fe5042a7ab admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002398 Aug 10 17:07:22.761832 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 17:07:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:23.264358 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-cff2aeea-bb8a-4e5e-80cb-c51dbdf134f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "vcpus": 4, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large"}} {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:23.271465 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG dbcounter [-] [106112] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:23.342051 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-cff2aeea-bb8a-4e5e-80cb-c51dbdf134f2 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.572760 Aug 10 17:07:23.342563 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 17:07:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:07:23.354785 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-9df20dba-408b-4034-a44f-8a57508adcaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:23.437406 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-9df20dba-408b-4034-a44f-8a57508adcaf admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086144 Aug 10 17:07:23.438100 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 10 17:07:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:25.726757 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-cff2aeea-bb8a-4e5e-80cb-c51dbdf134f2 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:25.727699 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-cff2aeea-bb8a-4e5e-80cb-c51dbdf134f2 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001695 Aug 10 17:07:25.728447 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 17:07:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:26.234742 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-eb37637e-a4d1-4577-93b8-8ef8c4866080 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "id": "5", "rxtx_factor": 1.0, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:26.400374 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-eb37637e-a4d1-4577-93b8-8ef8c4866080 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.665656 Aug 10 17:07:26.403453 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 17:07:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:07:26.419373 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-737e89c6-678c-4243-a6a3-ee207a5bbc4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:26.524451 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-737e89c6-678c-4243-a6a3-ee207a5bbc4f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110502 Aug 10 17:07:26.525407 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 10 17:07:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:07:47.280458 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-eb37637e-a4d1-4577-93b8-8ef8c4866080 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:47.281468 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-eb37637e-a4d1-4577-93b8-8ef8c4866080 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 10 17:07:47.281864 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 17:07:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:47.678345 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-16b15374-8ac3-4664-859c-0b402efa028e admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:47.696879 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-16b15374-8ac3-4664-859c-0b402efa028e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.408866 Aug 10 17:07:47.697424 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 10 17:07:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:07:48.777642 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-eb37637e-a4d1-4577-93b8-8ef8c4866080 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:48.778681 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-eb37637e-a4d1-4577-93b8-8ef8c4866080 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 10 17:07:48.779087 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 17:07:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:49.311604 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-d98b2aea-4c96-4b25-9842-2896f78508a1 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:49.317249 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.wsgi [None req-d98b2aea-4c96-4b25-9842-2896f78508a1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-d98b2aea-4c96-4b25-9842-2896f78508a1 admin admin] Request method failure captured: Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Accept: application/json Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Accept-Encoding: gzip, deflate Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Connection: keep-alive Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Content-Length: 0 Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Host: 10.222.0.45 Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Openstack-Api-Version: compute 2.90 Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Openstack-System-Scope: None Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: User-Agent: python-novaclient Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Auth-Token: gAAAAABi8-XkN8104BBC-NKW8cfdEbNkYQSm-RoW7GHBHVopc4T1ZHCYZ1H6G1iWrlOCc-Fp4qyQNpoobtPy3-31XCzCQma7e0NxIme5UyQlakpv_5rvNOdOrH8aI6pJHGn20IcT4qVi2_x_DqSr0p6KUY08PbsyODOZDY3jCDEs5oWczFJZ9Yk Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Domain-Id: None Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Domain-Name: None Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Identity-Status: Confirmed Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Is-Admin-Project: True Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Project-Domain-Id: default Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Project-Domain-Name: Default Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Project-Id: aff7d0faeed34f6193c691567931a8ff Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Project-Name: admin Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Role: member,reader,admin Aug 10 17:07:49.320544 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Roles: member,reader,admin Aug 10 17:07:49.322283 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_aff7d0faeed34f6193c691567931a8ff", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aff7d0faeed34f6193c691567931a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/aff7d0faeed34f6193c691567931a8ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aff7d0faeed34f6193c691567931a8ff"}]}] Aug 10 17:07:49.322283 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Tenant: admin Aug 10 17:07:49.322283 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Tenant-Id: aff7d0faeed34f6193c691567931a8ff Aug 10 17:07:49.322283 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Tenant-Name: admin Aug 10 17:07:49.322283 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User: admin Aug 10 17:07:49.322283 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User-Domain-Id: default Aug 10 17:07:49.322283 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User-Domain-Name: Default Aug 10 17:07:49.322283 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User-Id: 164faaac1ec04c50ba5358bf58d221cf Aug 10 17:07:49.322283 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User-Name: admin Aug 10 17:07:49.322283 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: method: > Aug 10 17:07:49.322283 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: exception: Flavor 42 could not be found. Aug 10 17:07:49.322283 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: action_args: {'id': '42'} Aug 10 17:07:49.322283 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:07:49.322283 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:49.323412 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:49.325439 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-d98b2aea-4c96-4b25-9842-2896f78508a1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:07:49.327054 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-d98b2aea-4c96-4b25-9842-2896f78508a1 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394822 Aug 10 17:07:49.327054 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 10 17:07:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:07:49.331930 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-f9059cfd-c6e9-4610-aa80-22d23ca8d5d3 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:49.336016 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG dbcounter [-] [106111] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:49.354154 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-f9059cfd-c6e9-4610-aa80-22d23ca8d5d3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025763 Aug 10 17:07:49.354727 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 10 17:07:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:07:49.364916 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-9f59f10b-af9c-4017-80dc-e1e38dd3360d admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:49.389193 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-9f59f10b-af9c-4017-80dc-e1e38dd3360d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027847 Aug 10 17:07:49.389726 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 10 17:07:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:07:49.399744 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-b71f148c-2974-4663-9093-c5dc545165b9 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:49.406483 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.wsgi [None req-b71f148c-2974-4663-9093-c5dc545165b9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-b71f148c-2974-4663-9093-c5dc545165b9 admin admin] Request method failure captured: Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Accept: application/json Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Accept-Encoding: gzip, deflate Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Connection: keep-alive Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Content-Length: 0 Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Host: 10.222.0.45 Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Openstack-Api-Version: compute 2.90 Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Openstack-System-Scope: None Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: User-Agent: python-novaclient Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Auth-Token: gAAAAABi8-XkN8104BBC-NKW8cfdEbNkYQSm-RoW7GHBHVopc4T1ZHCYZ1H6G1iWrlOCc-Fp4qyQNpoobtPy3-31XCzCQma7e0NxIme5UyQlakpv_5rvNOdOrH8aI6pJHGn20IcT4qVi2_x_DqSr0p6KUY08PbsyODOZDY3jCDEs5oWczFJZ9Yk Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Domain-Id: None Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Domain-Name: None Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Identity-Status: Confirmed Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Is-Admin-Project: True Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Project-Domain-Id: default Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Project-Domain-Name: Default Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Project-Id: aff7d0faeed34f6193c691567931a8ff Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Project-Name: admin Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Role: member,reader,admin Aug 10 17:07:49.410095 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Roles: member,reader,admin Aug 10 17:07:49.416429 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_aff7d0faeed34f6193c691567931a8ff", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aff7d0faeed34f6193c691567931a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/aff7d0faeed34f6193c691567931a8ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aff7d0faeed34f6193c691567931a8ff"}]}] Aug 10 17:07:49.416429 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Tenant: admin Aug 10 17:07:49.416429 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Tenant-Id: aff7d0faeed34f6193c691567931a8ff Aug 10 17:07:49.416429 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Tenant-Name: admin Aug 10 17:07:49.416429 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User: admin Aug 10 17:07:49.416429 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User-Domain-Id: default Aug 10 17:07:49.416429 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User-Domain-Name: Default Aug 10 17:07:49.416429 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User-Id: 164faaac1ec04c50ba5358bf58d221cf Aug 10 17:07:49.416429 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User-Name: admin Aug 10 17:07:49.416429 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: method: > Aug 10 17:07:49.416429 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: exception: Flavor 42 could not be found. Aug 10 17:07:49.416429 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: action_args: {'id': '42'} Aug 10 17:07:49.416429 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:07:49.416429 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:49.417380 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:49.419366 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-b71f148c-2974-4663-9093-c5dc545165b9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:07:49.420586 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-b71f148c-2974-4663-9093-c5dc545165b9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015652 Aug 10 17:07:49.420586 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 10 17:07:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:07:50.384781 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-9f59f10b-af9c-4017-80dc-e1e38dd3360d admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:50.385806 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-9f59f10b-af9c-4017-80dc-e1e38dd3360d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 10 17:07:50.386207 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 17:07:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:50.909905 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-a318a930-5790-4748-ae79-7b72c20cb0ac admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:50.917049 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.wsgi [None req-a318a930-5790-4748-ae79-7b72c20cb0ac admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-a318a930-5790-4748-ae79-7b72c20cb0ac admin admin] Request method failure captured: Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Accept: application/json Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Accept-Encoding: gzip, deflate Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Connection: keep-alive Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Content-Length: 0 Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Host: 10.222.0.45 Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Openstack-Api-Version: compute 2.90 Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Openstack-System-Scope: None Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: User-Agent: python-novaclient Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Auth-Token: gAAAAABi8-XmMu6KMmMHlr2frHhJWxvjGnvbs2Qo4jFj0-p3-JbrnaeTLKeskJcMqIb0Ma7DIGj_n5q319q_XVgRRp4ME65QCEmaaZyOvVNhWGst-ylQFCUza0SMoOZEY1_MVnvi-R0103NN3W950lhJinMdxcm8BfXGbUxOScgstoFzUMnBzME Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Domain-Id: None Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Domain-Name: None Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Identity-Status: Confirmed Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Is-Admin-Project: True Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Project-Domain-Id: default Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Project-Domain-Name: Default Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Project-Id: aff7d0faeed34f6193c691567931a8ff Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Project-Name: admin Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Role: member,reader,admin Aug 10 17:07:50.919281 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Roles: member,reader,admin Aug 10 17:07:50.920816 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_aff7d0faeed34f6193c691567931a8ff", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aff7d0faeed34f6193c691567931a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/aff7d0faeed34f6193c691567931a8ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aff7d0faeed34f6193c691567931a8ff"}]}] Aug 10 17:07:50.920816 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Tenant: admin Aug 10 17:07:50.920816 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Tenant-Id: aff7d0faeed34f6193c691567931a8ff Aug 10 17:07:50.920816 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Tenant-Name: admin Aug 10 17:07:50.920816 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User: admin Aug 10 17:07:50.920816 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User-Domain-Id: default Aug 10 17:07:50.920816 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User-Domain-Name: Default Aug 10 17:07:50.920816 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User-Id: 164faaac1ec04c50ba5358bf58d221cf Aug 10 17:07:50.920816 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User-Name: admin Aug 10 17:07:50.920816 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: method: > Aug 10 17:07:50.920816 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: exception: Flavor 84 could not be found. Aug 10 17:07:50.920816 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: action_args: {'id': '84'} Aug 10 17:07:50.920816 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:07:50.920816 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:50.922039 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:50.924234 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-a318a930-5790-4748-ae79-7b72c20cb0ac admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:07:50.926172 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-a318a930-5790-4748-ae79-7b72c20cb0ac admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.395208 Aug 10 17:07:50.926172 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 10 17:07:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:07:50.930509 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-8d23df32-0d9e-4205-a4a1-87e6deab75e9 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:50.945728 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-8d23df32-0d9e-4205-a4a1-87e6deab75e9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018730 Aug 10 17:07:50.946256 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 10 17:07:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:07:50.956170 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-f8d6a8cf-7b91-4831-b472-139328f25a1a admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:50.971265 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-f8d6a8cf-7b91-4831-b472-139328f25a1a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018561 Aug 10 17:07:50.971820 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 10 17:07:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:07:50.981175 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-848847fb-7d4a-4fef-b1c9-7f9ae05c84cb admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:50.986458 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.wsgi [None req-848847fb-7d4a-4fef-b1c9-7f9ae05c84cb admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-848847fb-7d4a-4fef-b1c9-7f9ae05c84cb admin admin] Request method failure captured: Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Accept: application/json Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Accept-Encoding: gzip, deflate Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Connection: keep-alive Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Content-Length: 0 Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Host: 10.222.0.45 Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Openstack-Api-Version: compute 2.90 Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Openstack-System-Scope: None Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: User-Agent: python-novaclient Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Auth-Token: gAAAAABi8-XmMu6KMmMHlr2frHhJWxvjGnvbs2Qo4jFj0-p3-JbrnaeTLKeskJcMqIb0Ma7DIGj_n5q319q_XVgRRp4ME65QCEmaaZyOvVNhWGst-ylQFCUza0SMoOZEY1_MVnvi-R0103NN3W950lhJinMdxcm8BfXGbUxOScgstoFzUMnBzME Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Domain-Id: None Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Domain-Name: None Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Identity-Status: Confirmed Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Is-Admin-Project: True Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Project-Domain-Id: default Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Project-Domain-Name: Default Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Project-Id: aff7d0faeed34f6193c691567931a8ff Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Project-Name: admin Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Role: member,reader,admin Aug 10 17:07:50.987946 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Roles: member,reader,admin Aug 10 17:07:50.989425 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_aff7d0faeed34f6193c691567931a8ff", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aff7d0faeed34f6193c691567931a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/aff7d0faeed34f6193c691567931a8ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aff7d0faeed34f6193c691567931a8ff"}]}] Aug 10 17:07:50.989425 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Tenant: admin Aug 10 17:07:50.989425 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Tenant-Id: aff7d0faeed34f6193c691567931a8ff Aug 10 17:07:50.989425 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Tenant-Name: admin Aug 10 17:07:50.989425 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User: admin Aug 10 17:07:50.989425 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User-Domain-Id: default Aug 10 17:07:50.989425 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User-Domain-Name: Default Aug 10 17:07:50.989425 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User-Id: 164faaac1ec04c50ba5358bf58d221cf Aug 10 17:07:50.989425 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User-Name: admin Aug 10 17:07:50.989425 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: method: > Aug 10 17:07:50.989425 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: exception: Flavor 84 could not be found. Aug 10 17:07:50.989425 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: action_args: {'id': '84'} Aug 10 17:07:50.989425 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:07:50.989425 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:50.990452 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:50.991729 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-848847fb-7d4a-4fef-b1c9-7f9ae05c84cb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:07:50.992973 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-848847fb-7d4a-4fef-b1c9-7f9ae05c84cb admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011741 Aug 10 17:07:50.992973 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 10 17:07:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:07:51.978671 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-f8d6a8cf-7b91-4831-b472-139328f25a1a admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:51.979686 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-f8d6a8cf-7b91-4831-b472-139328f25a1a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 10 17:07:51.980146 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 17:07:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:52.524654 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-d0624b6f-45d5-478f-9f9d-64a3ba2fe983 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:52.530991 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.wsgi [None req-d0624b6f-45d5-478f-9f9d-64a3ba2fe983 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-d0624b6f-45d5-478f-9f9d-64a3ba2fe983 admin admin] Request method failure captured: Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Accept: application/json Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Accept-Encoding: gzip, deflate Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Connection: keep-alive Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Content-Length: 0 Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Host: 10.222.0.45 Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Openstack-Api-Version: compute 2.90 Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Openstack-System-Scope: None Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: User-Agent: python-novaclient Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Auth-Token: gAAAAABi8-XnLTi6bRLLx8dIyNRRDb2WRARhdvPuEePWdyZW9SqDAaXDdTN6l0T3yaHz6p4gGvAYggQFy8Ad64FxI5Jeg4AN_DbKCjovgTfe8r-6fB3F1Pvl9Pw-E73OZReETbe0CJKBfrUNRKrYQxAlvJc82B61oUdI-38x-mN1TDcOj4YwoOE Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Domain-Id: None Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Domain-Name: None Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Identity-Status: Confirmed Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Is-Admin-Project: True Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Project-Domain-Id: default Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Project-Domain-Name: Default Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Project-Id: aff7d0faeed34f6193c691567931a8ff Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Project-Name: admin Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Role: member,reader,admin Aug 10 17:07:52.532492 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Roles: member,reader,admin Aug 10 17:07:52.534067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_aff7d0faeed34f6193c691567931a8ff", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aff7d0faeed34f6193c691567931a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/aff7d0faeed34f6193c691567931a8ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aff7d0faeed34f6193c691567931a8ff"}]}] Aug 10 17:07:52.534067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Tenant: admin Aug 10 17:07:52.534067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Tenant-Id: aff7d0faeed34f6193c691567931a8ff Aug 10 17:07:52.534067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-Tenant-Name: admin Aug 10 17:07:52.534067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User: admin Aug 10 17:07:52.534067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User-Domain-Id: default Aug 10 17:07:52.534067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User-Domain-Name: Default Aug 10 17:07:52.534067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User-Id: 164faaac1ec04c50ba5358bf58d221cf Aug 10 17:07:52.534067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: X-User-Name: admin Aug 10 17:07:52.534067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: method: > Aug 10 17:07:52.534067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: exception: Flavor 451 could not be found. Aug 10 17:07:52.534067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: action_args: {'id': '451'} Aug 10 17:07:52.534067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:07:52.534067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:52.535056 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: ERROR nova.api.openstack.wsgi Aug 10 17:07:52.536326 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-d0624b6f-45d5-478f-9f9d-64a3ba2fe983 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:07:52.537584 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-d0624b6f-45d5-478f-9f9d-64a3ba2fe983 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.416313 Aug 10 17:07:52.537584 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 10 17:07:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:07:52.543556 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-d0d515f3-4742-4e72-b7f4-b31b7947d677 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:52.558868 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-d0d515f3-4742-4e72-b7f4-b31b7947d677 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018209 Aug 10 17:07:52.559492 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 10 17:07:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:07:52.569483 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-b3bcd699-a1b9-4014-a088-efe5688b4ae3 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:52.585583 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-b3bcd699-a1b9-4014-a088-efe5688b4ae3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019854 Aug 10 17:07:52.586155 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 10 17:07:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:07:52.596100 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-065a717f-0b7e-4e95-9a51-0ee014fde16e admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:52.601646 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.wsgi [None req-065a717f-0b7e-4e95-9a51-0ee014fde16e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-065a717f-0b7e-4e95-9a51-0ee014fde16e admin admin] Request method failure captured: Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Accept: application/json Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Accept-Encoding: gzip, deflate Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Connection: keep-alive Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Content-Length: 0 Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Host: 10.222.0.45 Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Openstack-Api-Version: compute 2.90 Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Openstack-System-Scope: None Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: User-Agent: python-novaclient Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Auth-Token: gAAAAABi8-XnLTi6bRLLx8dIyNRRDb2WRARhdvPuEePWdyZW9SqDAaXDdTN6l0T3yaHz6p4gGvAYggQFy8Ad64FxI5Jeg4AN_DbKCjovgTfe8r-6fB3F1Pvl9Pw-E73OZReETbe0CJKBfrUNRKrYQxAlvJc82B61oUdI-38x-mN1TDcOj4YwoOE Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Domain-Id: None Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Domain-Name: None Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Identity-Status: Confirmed Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Is-Admin-Project: True Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Project-Domain-Id: default Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Project-Domain-Name: Default Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Project-Id: aff7d0faeed34f6193c691567931a8ff Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Project-Name: admin Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Role: member,reader,admin Aug 10 17:07:52.603214 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Roles: member,reader,admin Aug 10 17:07:52.604773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_aff7d0faeed34f6193c691567931a8ff", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aff7d0faeed34f6193c691567931a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/aff7d0faeed34f6193c691567931a8ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aff7d0faeed34f6193c691567931a8ff"}]}] Aug 10 17:07:52.604773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Tenant: admin Aug 10 17:07:52.604773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Tenant-Id: aff7d0faeed34f6193c691567931a8ff Aug 10 17:07:52.604773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-Tenant-Name: admin Aug 10 17:07:52.604773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User: admin Aug 10 17:07:52.604773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User-Domain-Id: default Aug 10 17:07:52.604773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User-Domain-Name: Default Aug 10 17:07:52.604773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User-Id: 164faaac1ec04c50ba5358bf58d221cf Aug 10 17:07:52.604773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: X-User-Name: admin Aug 10 17:07:52.604773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: method: > Aug 10 17:07:52.604773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: exception: Flavor 451 could not be found. Aug 10 17:07:52.604773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: action_args: {'id': '451'} Aug 10 17:07:52.604773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:07:52.604773 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:52.605795 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: ERROR nova.api.openstack.wsgi Aug 10 17:07:52.607032 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-065a717f-0b7e-4e95-9a51-0ee014fde16e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:07:52.608353 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-065a717f-0b7e-4e95-9a51-0ee014fde16e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012154 Aug 10 17:07:52.608353 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 10 17:07:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 17:07:53.585027 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-b3bcd699-a1b9-4014-a088-efe5688b4ae3 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:53.586067 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-b3bcd699-a1b9-4014-a088-efe5688b4ae3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 10 17:07:53.586493 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 17:07:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:54.126489 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-c4d6b77e-8618-4577-bb76-7adbd3bbba56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:54.274045 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-c4d6b77e-8618-4577-bb76-7adbd3bbba56 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.548060 Aug 10 17:07:54.274814 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 10 17:07:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:07:55.255027 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-b3bcd699-a1b9-4014-a088-efe5688b4ae3 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:55.256054 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-b3bcd699-a1b9-4014-a088-efe5688b4ae3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 10 17:07:55.256458 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 17:07:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:55.796180 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-aaf2c6f8-f55f-44f4-86da-28afd9e2d0dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:55.907523 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-aaf2c6f8-f55f-44f4-86da-28afd9e2d0dc admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.510764 Aug 10 17:07:55.908085 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 10 17:07:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:07:56.892354 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-b3bcd699-a1b9-4014-a088-efe5688b4ae3 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:56.893387 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-b3bcd699-a1b9-4014-a088-efe5688b4ae3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001722 Aug 10 17:07:56.893790 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 17:07:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:57.421992 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-7700f5df-b471-4d5c-a7a0-44afe5bdef3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:57.501654 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-7700f5df-b471-4d5c-a7a0-44afe5bdef3a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.469055 Aug 10 17:07:57.502118 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 10 17:07:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:07:58.492148 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-b3bcd699-a1b9-4014-a088-efe5688b4ae3 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:07:58.493163 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-b3bcd699-a1b9-4014-a088-efe5688b4ae3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 10 17:07:58.493562 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 17:07:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:07:59.035057 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-3045f92b-94fd-4337-af43-3f546a815d0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:07:59.114099 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-3045f92b-94fd-4337-af43-3f546a815d0d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.480612 Aug 10 17:07:59.114681 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 10 17:07:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:08:00.100589 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-b3bcd699-a1b9-4014-a088-efe5688b4ae3 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:00.101692 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-b3bcd699-a1b9-4014-a088-efe5688b4ae3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 10 17:08:00.102099 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 17:08:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:08:00.647319 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-8def6279-4ac3-4f21-a755-91ffbea4d9f7 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:00.669537 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-8def6279-4ac3-4f21-a755-91ffbea4d9f7 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.427291 Aug 10 17:08:00.670108 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Wed Aug 10 17:08:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:08:52.978516 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-b3bcd699-a1b9-4014-a088-efe5688b4ae3 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:52.980272 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-b3bcd699-a1b9-4014-a088-efe5688b4ae3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002225 Aug 10 17:08:52.980679 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 17:08:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:08:52.991158 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG dbcounter [-] [106111] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:53.372988 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-792ece21-d961-471d-abf5-2917f019ce74 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:53.393462 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-792ece21-d961-471d-abf5-2917f019ce74 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406843 Aug 10 17:08:53.393999 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 10 17:08:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:08:53.415417 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG dbcounter [-] [106112] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:53.420006 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-20e6c8cd-9c8f-4893-a06b-cd8746edd71c admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:53.428650 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-20e6c8cd-9c8f-4893-a06b-cd8746edd71c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014606 Aug 10 17:08:53.431289 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1283 bytes} [Wed Aug 10 17:08:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:53.441860 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-dd471b85-ace9-484e-9f26-d3a8ed6a7d98 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:53.450002 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-dd471b85-ace9-484e-9f26-d3a8ed6a7d98 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011741 Aug 10 17:08:53.450578 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1286 bytes} [Wed Aug 10 17:08:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:53.462673 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-0739efb9-30c1-4188-bde7-91f1c5fc0965 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:53.471275 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-0739efb9-30c1-4188-bde7-91f1c5fc0965 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012501 Aug 10 17:08:53.471732 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1286 bytes} [Wed Aug 10 17:08:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:08:53.484271 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-a299dbfd-cb38-4c7f-bdcf-56afd481a1b0 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:08:53.492087 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-a299dbfd-cb38-4c7f-bdcf-56afd481a1b0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011478 Aug 10 17:08:53.492607 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1283 bytes} [Wed Aug 10 17:08:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:12:05.606958 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-0739efb9-30c1-4188-bde7-91f1c5fc0965 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:12:05.607978 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-0739efb9-30c1-4188-bde7-91f1c5fc0965 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 10 17:12:05.608717 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 17:12:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:12:05.753939 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG dbcounter [-] [106111] Writing DB stats nova_api:SELECT=6 {{(pid=106111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:12:05.912539 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-0623761e-289b-4f85-926a-a93e6bca1832 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:12:05.914892 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:12:05.914892 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: warnings.warn(msg) Aug 10 17:12:05.916033 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-0623761e-289b-4f85-926a-a93e6bca1832 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:12:05.916517 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-0623761e-289b-4f85-926a-a93e6bca1832 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:12:05.916941 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-0623761e-289b-4f85-926a-a93e6bca1832 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:12:05.918392 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-0623761e-289b-4f85-926a-a93e6bca1832 admin admin] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:12:05.918843 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-0623761e-289b-4f85-926a-a93e6bca1832 admin admin] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:12:05.919262 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-0623761e-289b-4f85-926a-a93e6bca1832 admin admin] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:12:05.953471 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-0623761e-289b-4f85-926a-a93e6bca1832 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.201097 Aug 10 17:12:05.954057 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 10 17:12:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:12:06.798457 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-0739efb9-30c1-4188-bde7-91f1c5fc0965 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:12:06.799484 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-0739efb9-30c1-4188-bde7-91f1c5fc0965 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 10 17:12:06.799894 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 17:12:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:12:06.997830 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-1a8f87d2-ee4f-4d33-a236-6963fe570bf2 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:12:07.000305 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:12:07.000305 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: warnings.warn(msg) Aug 10 17:12:07.001492 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-1a8f87d2-ee4f-4d33-a236-6963fe570bf2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:12:07.001976 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-1a8f87d2-ee4f-4d33-a236-6963fe570bf2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:12:07.002437 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-1a8f87d2-ee4f-4d33-a236-6963fe570bf2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:12:07.003176 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-1a8f87d2-ee4f-4d33-a236-6963fe570bf2 admin admin] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:12:07.003622 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-1a8f87d2-ee4f-4d33-a236-6963fe570bf2 admin admin] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:12:07.004038 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-1a8f87d2-ee4f-4d33-a236-6963fe570bf2 admin admin] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:12:07.025698 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-1a8f87d2-ee4f-4d33-a236-6963fe570bf2 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082865 Aug 10 17:12:07.026280 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 10 17:12:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:12:18.284831 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-0739efb9-30c1-4188-bde7-91f1c5fc0965 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:12:18.285887 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-0739efb9-30c1-4188-bde7-91f1c5fc0965 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 10 17:12:18.286288 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 36/73] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 17:12:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:12:18.431203 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG dbcounter [-] [106111] Writing DB stats nova_cell0:SELECT=4 {{(pid=106111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:12:18.431950 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG dbcounter [-] [106111] Writing DB stats nova_cell1:SELECT=4 {{(pid=106111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:12:18.432581 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG dbcounter [-] [106111] Writing DB stats nova_api:SELECT=8 {{(pid=106111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:12:18.481871 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-8c30406a-cfbc-43ee-978e-1df6da1c1e12 admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:12:18.484494 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:12:18.484494 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: warnings.warn(msg) Aug 10 17:12:18.485609 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-8c30406a-cfbc-43ee-978e-1df6da1c1e12 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:12:18.486091 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-8c30406a-cfbc-43ee-978e-1df6da1c1e12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:12:18.486556 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-8c30406a-cfbc-43ee-978e-1df6da1c1e12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:12:18.487278 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-8c30406a-cfbc-43ee-978e-1df6da1c1e12 admin admin] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:12:18.487726 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-8c30406a-cfbc-43ee-978e-1df6da1c1e12 admin admin] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:12:18.488250 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-8c30406a-cfbc-43ee-978e-1df6da1c1e12 admin admin] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:12:18.515483 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-8c30406a-cfbc-43ee-978e-1df6da1c1e12 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088818 Aug 10 17:12:18.515975 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 38/74] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 10 17:12:18 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:12:19.352961 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: DEBUG nova.api.openstack.wsgi [None req-0739efb9-30c1-4188-bde7-91f1c5fc0965 admin admin] Calling method '>' {{(pid=106112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:12:19.353988 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: INFO nova.api.openstack.requestlog [None req-0739efb9-30c1-4188-bde7-91f1c5fc0965 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 10 17:12:19.354460 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: [pid: 106112|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 17:12:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:12:19.548356 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG nova.api.openstack.wsgi [None req-64fb4c7e-e46c-49b6-8b20-78920951c0db admin admin] Calling method '>' {{(pid=106111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:12:19.550785 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:12:19.550785 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: warnings.warn(msg) Aug 10 17:12:19.551914 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-64fb4c7e-e46c-49b6-8b20-78920951c0db admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:12:19.552394 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-64fb4c7e-e46c-49b6-8b20-78920951c0db admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:12:19.552824 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-64fb4c7e-e46c-49b6-8b20-78920951c0db admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:12:19.553567 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-64fb4c7e-e46c-49b6-8b20-78920951c0db admin admin] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:12:19.554013 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-64fb4c7e-e46c-49b6-8b20-78920951c0db admin admin] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:12:19.554466 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: DEBUG oslo_concurrency.lockutils [None req-64fb4c7e-e46c-49b6-8b20-78920951c0db admin admin] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:12:19.576140 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: INFO nova.api.openstack.requestlog [None req-64fb4c7e-e46c-49b6-8b20-78920951c0db admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081016 Aug 10 17:12:19.576595 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: [pid: 106111|app: 0|req: 39/76] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 10 17:12:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:13:16.350097 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: Wed Aug 10 17:13:16 2022 - graceful shutdown triggered... Aug 10 17:13:16.349584 dv-cinder-852724-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 17:13:16.351165 dv-cinder-852724-3-iscsi devstack@n-api.service[106111]: Gracefully killing worker 1 (pid: 106111)... Aug 10 17:13:16.351536 dv-cinder-852724-3-iscsi devstack@n-api.service[106112]: Gracefully killing worker 2 (pid: 106112)... Aug 10 17:13:17.350500 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: worker 1 buried after 1 seconds Aug 10 17:13:17.351344 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: worker 2 buried after 1 seconds Aug 10 17:13:17.351344 dv-cinder-852724-3-iscsi devstack@n-api.service[106110]: goodbye to uWSGI. Aug 10 17:13:17.352460 dv-cinder-852724-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 17:13:17.353039 dv-cinder-852724-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 17:13:17.356482 dv-cinder-852724-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 17:13:17.367341 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 17:13:17.369956 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 17:13:17 2022] *** Aug 10 17:13:17.370119 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 17:13:17.370259 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 17:13:17.370499 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: nodename: dv-cinder-852724-3-iscsi Aug 10 17:13:17.370634 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: machine: x86_64 Aug 10 17:13:17.370634 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: clock source: unix Aug 10 17:13:17.370634 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: pcre jit disabled Aug 10 17:13:17.370634 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: detected number of CPU cores: 4 Aug 10 17:13:17.370634 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: current working directory: / Aug 10 17:13:17.370634 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: detected binary path: /usr/bin/uwsgi-core Aug 10 17:13:17.370634 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: your processes number limit is 47680 Aug 10 17:13:17.370634 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: your memory page size is 4096 bytes Aug 10 17:13:17.371194 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: detected max file descriptor number: 2048 Aug 10 17:13:17.371194 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: lock engine: pthread robust mutexes Aug 10 17:13:17.371194 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: thunder lock: enabled Aug 10 17:13:17.371194 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 17:13:17.371194 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 17:13:17.412148 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: Python main interpreter initialized at 0x55c700f729c0 Aug 10 17:13:17.412148 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: python threads support enabled Aug 10 17:13:17.412148 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: your server socket listen backlog is limited to 100 connections Aug 10 17:13:17.412148 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: your mercy for graceful operations on workers is 90 seconds Aug 10 17:13:17.412763 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 17:13:17.412763 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: *** Operational MODE: preforking *** Aug 10 17:13:17.412976 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: *** uWSGI is running in multiple interpreter mode *** Aug 10 17:13:17.412976 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: spawned uWSGI master process (pid: 121217) Aug 10 17:13:17.413163 dv-cinder-852724-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 17:13:17.414409 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: spawned uWSGI worker 1 (pid: 121231, cores: 1) Aug 10 17:13:17.414409 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: spawned uWSGI worker 2 (pid: 121232, cores: 1) Aug 10 17:13:17.414409 dv-cinder-852724-3-iscsi devstack@n-api.service[121217]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 17:13:18.098391 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 17:13:18.100142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 17:13:19.284017 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:13:19.284017 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: from cryptography.utils import int_from_bytes Aug 10 17:13:19.284645 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:13:19.284645 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: from cryptography.utils import int_from_bytes Aug 10 17:13:20.157309 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:13:20.157309 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: from cryptography.utils import int_from_bytes Aug 10 17:13:20.157956 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 17:13:20.157956 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: from cryptography.utils import int_from_bytes Aug 10 17:13:21.679177 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 17:13:21.679177 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 17:13:21.679177 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 17:13:21.679177 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 17:13:21.679177 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 17:13:21.679177 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.679177 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.680134 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.680134 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.680134 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.680733 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.680733 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.681018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.681356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.681637 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.681952 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.682308 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852724-3-iscsi {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.682636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.682950 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.683264 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.684123 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.684437 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.684764 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.685073 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.685585 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.687037 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.687037 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.687037 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.687316 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.687607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.687921 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.688249 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.688551 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.688879 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.689192 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.689602 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852724-3-iscsi {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.689936 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.690254 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.690594 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.691009 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.691329 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.691647 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.691977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.692305 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.692617 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.692962 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.693285 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.693611 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.693942 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.694255 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.694658 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.694976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.695304 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.695616 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.695923 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.696175 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.696490 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.696815 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.697140 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.697467 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.697723 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.697975 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.698311 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.698666 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.699762 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.700081 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.700318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.700513 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.700757 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.701071 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.701383 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.701687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.702066 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.702325 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.702675 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.702990 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.703316 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.703729 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.703993 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.704378 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.704649 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.704975 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.705298 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.705609 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.705936 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.706243 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.706575 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.706886 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.707207 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.707549 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.707858 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.708114 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.708457 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.708779 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.709042 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.709355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.709665 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.709977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.710283 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.710623 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.710935 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.711250 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.711559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.711868 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.712185 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.712487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.712795 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.713106 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.713431 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.713755 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.714071 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.714404 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.714761 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.715122 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.715385 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.715694 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.716062 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.716392 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.716630 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.716939 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.717260 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.717571 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.717880 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.718202 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.718574 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.719476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.719476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.719809 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.720072 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.720379 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.720688 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.720999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.721310 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.721617 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.721924 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.722227 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.722577 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.722919 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.723253 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.723567 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.723884 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.724207 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:21.724550 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.724887 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.725235 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.725584 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.725962 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.726300 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.726648 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.726964 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.727283 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.727613 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.727931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.728246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.728569 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.728897 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.729219 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.729553 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.729872 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.730289 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.731007 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.731007 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.731521 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.731861 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.732206 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.732506 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.732855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.733207 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.733527 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.733857 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.734194 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.734535 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.734852 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.735166 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.735493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.735833 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.736148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.736469 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.736783 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.737099 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.737413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.737725 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.738038 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.738414 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.738725 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.739045 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.739362 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.739682 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.739996 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.740311 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.740625 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.740931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.741237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.741542 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.741845 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.742152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.742499 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.742832 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.743142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.743478 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.743785 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.744104 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.744416 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.744729 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.745035 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.745351 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.745659 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.746727 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.746727 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.747392 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.747695 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.748021 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.748330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.748641 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.748973 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.749274 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.749586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.749899 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.750213 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.750568 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.750887 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.751198 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.751534 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.751867 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.752177 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.752505 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.752829 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.753149 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.753459 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.753766 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.754073 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.754394 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.754714 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.755026 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.755342 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.755640 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.755943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.756246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.756553 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.756881 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.757188 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.757495 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.757803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.758107 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.758479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.758790 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.759133 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.759474 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.759798 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.760125 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.760440 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.760761 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.761066 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.761388 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.762596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.762596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.763275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.763701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.763943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.764200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.764529 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.764849 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.765176 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.765485 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.765804 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.766146 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.766508 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.766841 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.767160 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.767472 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.767790 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.768103 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.768457 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.768727 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.769043 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.769365 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.769676 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.769996 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.770307 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.770661 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.770972 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.771296 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.771601 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.771918 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.772255 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.772593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.772904 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.773219 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.773545 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.773858 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.774858 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.774858 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.774858 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.775309 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.775462 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.776083 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.776083 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.776408 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.776610 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.776945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.777967 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.778781 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.778946 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.779243 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.779593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.779915 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.780246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.780576 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.780888 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.781197 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.781590 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.781909 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.782222 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.782564 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.782877 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.783238 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.783555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.783865 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.784326 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.784504 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.784816 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.785140 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.785463 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.785775 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.786430 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.786430 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.786744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.787050 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.787363 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.787677 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.788020 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.788317 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.788631 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.788948 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.789263 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.789584 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.790052 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.790213 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.790810 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.791150 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.791626 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.792022 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.792309 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.792459 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.792809 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.793754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.793754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.794557 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.794799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.795053 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.795364 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.795680 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.795989 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.796606 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.796606 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.796924 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.797184 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.797490 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.797795 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.798107 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.798450 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.798757 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.799074 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.799381 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.799715 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.800026 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.800366 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.800640 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.800945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.801295 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.801606 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.801948 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.802281 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.802653 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.802962 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.803271 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.803597 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.803904 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.804210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.804522 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.804836 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.805142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.805447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.805763 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.806073 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.806411 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.806832 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.807012 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.807320 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.807624 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.807944 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.808260 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.808789 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.809191 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.809512 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.809819 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.810127 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.810473 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.810787 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.811107 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.811416 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.811724 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.812030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.812337 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.812646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.812954 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.813309 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.813646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.813931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.814240 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.814599 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.814935 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.815217 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.815532 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.815864 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.816189 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.816495 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.816906 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.817111 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.817424 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.817729 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.818115 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.818340 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.818658 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.818967 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.819273 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.819581 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.819916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.820227 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.820534 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.820839 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.821146 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.821501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.821810 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.822180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.822642 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.823045 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.823282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.823620 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.824025 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.824259 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.824578 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.825063 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.825384 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.825701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.826012 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.826319 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.826690 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.827006 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.837346 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.837346 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.837346 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.837346 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.837346 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.837346 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.837346 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.837346 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.838963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.840229 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.840229 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.840229 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.840229 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.840229 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.840229 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.840229 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.840229 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.841607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.841607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.841607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.841607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.841607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.841607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.841607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.841607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.842212 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.842212 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.842212 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.842212 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.842212 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.842212 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.842853 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.842853 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.843024 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.843356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.843670 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.843977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.844401 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.844715 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.845027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.845422 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.845777 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.846103 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.846501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.846823 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.847136 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.847464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.847789 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.848103 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.848419 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.848726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.849052 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.849414 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.849690 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.850012 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.850491 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.850778 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.851091 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.851415 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.851742 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.852050 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.852356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.852669 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.853044 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.853333 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.853662 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.853969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.854283 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.854622 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.854933 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.855804 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.856118 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.856448 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.856752 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.857064 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.857382 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.857708 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.858030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.858335 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.858678 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.858990 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.859294 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.862487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.862487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.862487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.862487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.862487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.862487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.862487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.862487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.863180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.863180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.863180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.863180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.863532 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.863702 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.864008 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.864364 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.864676 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.864989 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.865297 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.865609 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.865914 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.866220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.866555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.866895 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.867204 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.867530 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.867841 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.868147 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.868454 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.868759 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.869103 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.869410 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.869738 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.870076 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.870429 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.870752 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.871113 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.871434 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.871754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.872072 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.872392 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.872711 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.873023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.873381 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.873663 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.874043 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.874643 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.874984 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.875299 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.875615 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.875931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.876248 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.876565 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.876880 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.877196 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.877509 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.877823 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.878156 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.878507 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.878839 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.879181 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.879503 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.879864 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.880198 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.880513 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.880876 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.881198 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.881512 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.881829 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.882147 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.882494 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.882815 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.883127 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.883446 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.883762 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.884078 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.884391 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.884708 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.885030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.885363 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.885694 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.886014 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.886330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.887283 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.887615 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.888147 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.888715 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.889050 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.889386 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.889709 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.890028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.890369 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.894629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.894629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.894629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.894629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.894629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.894629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.894629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.894629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.895180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.895180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.895180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.895180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.895180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.895180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.895652 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.895652 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.895926 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.896237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.896568 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.896880 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.897190 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.897513 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.897826 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.898135 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.898470 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.898786 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.899100 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.899410 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.899723 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.900028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.900359 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.900670 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.900980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.901288 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.901604 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.901913 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.902903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.903227 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.903597 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.903934 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.904245 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.904559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.904874 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.905191 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.905503 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.905816 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.906125 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.906477 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.906787 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.907147 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.907469 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.907784 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.908111 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.908425 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.908741 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.909091 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.909416 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.909969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.910365 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.910689 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.911031 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.911371 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.911683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.911996 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.912305 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.912634 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.912953 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.913264 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.913578 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.913891 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.914206 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.914542 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.914865 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.915177 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.915490 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.915800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.916111 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.916420 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.916730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.917041 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.917357 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.917774 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.918332 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.918768 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.919094 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.919416 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.919736 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.920115 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.920430 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.920746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.921064 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.921401 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.921718 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.922027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.922484 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.922805 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.923127 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.923453 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.923771 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.924100 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.924427 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.924748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.925070 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.925381 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.925713 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.926061 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.926414 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.926743 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.927103 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.927424 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.927731 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.928044 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.928365 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.928679 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.928986 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.929378 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.929610 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.929913 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.930221 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.930556 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.930868 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.931181 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.931490 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.931797 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.932104 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.932412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.932718 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.933053 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.933432 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.933993 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.935088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.935088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.935088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.935352 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.935615 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.935953 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.936272 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.936601 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.936916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.937244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.937559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.937885 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.938209 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.938564 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.938893 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.939215 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.939529 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.939848 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.940159 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.940472 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.940785 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.941098 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.941430 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.941762 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.942073 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.942431 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.942758 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.943086 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.943403 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.943718 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.944052 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.944371 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.944689 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.945001 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.945315 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.945629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.945945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.946259 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.946600 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.946920 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.947237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.947568 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.947896 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.948209 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.948539 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.948873 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.949797 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.949797 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.950428 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.950761 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.951084 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.951399 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.951707 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:21.951955 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 17:13:22.104533 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO dbcounter [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] Registered counter for database nova_api Aug 10 17:13:22.126171 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_db.sqlalchemy.engines [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:13:22.132997 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writer thread running {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:13:22.197447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.context [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),180adeb5-bada-47d6-898d-063cb32f2e64(cell1) {{(pid=121232) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 17:13:22.201822 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:13:22.202303 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:13:22.203896 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:13:22.204635 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:13:22.205088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:13:22.207122 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:13:22.209123 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO dbcounter [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] Registered counter for database nova_cell0 Aug 10 17:13:22.213275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO dbcounter [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] Registered counter for database nova_cell1 Aug 10 17:13:22.221377 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_db.sqlalchemy.engines [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:13:22.223384 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_db.sqlalchemy.engines [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:13:22.231802 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writer thread running {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:13:22.232148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writer thread running {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:13:22.380801 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO dbcounter [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] Registered counter for database nova_cell0 Aug 10 17:13:22.388778 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_db.sqlalchemy.engines [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:13:22.393245 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writer thread running {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:13:22.720927 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: WARNING keystonemiddleware.auth_token [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:13:22.729013 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: WARNING keystonemiddleware.auth_token [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:13:23.032490 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 17:13:23.033009 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 17:13:23.033830 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 17:13:23.034521 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 17:13:23.034982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 17:13:23.035684 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.036279 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.036866 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.037470 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.038087 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.038706 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.039313 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.039925 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.040777 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.041274 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.041878 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.042536 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852724-3-iscsi {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.044400 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.044400 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.044898 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.045521 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.046077 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.046733 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.047341 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.048346 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.048937 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.049757 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.050384 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.051051 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.051661 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.052266 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.052889 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.053485 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.054114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.054733 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.055484 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852724-3-iscsi {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.056093 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.056697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.057305 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.058120 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.059651 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.060260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.060882 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.061503 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.062104 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.062781 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.063402 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.064020 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.064637 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.065223 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.065801 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.066534 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.067073 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.067640 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.068460 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.068953 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.069560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.070194 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.070854 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.071488 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.071979 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.072469 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.073091 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.073710 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.074657 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.075260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.075867 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.076477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.077081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.077678 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.078279 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.078916 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.079525 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.080142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.080761 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.081367 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.081581 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: WARNING keystonemiddleware.auth_token [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:13:23.081993 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.082808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.083296 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.083907 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.084571 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.085188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.085802 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.086448 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.087037 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.087609 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: WARNING keystonemiddleware.auth_token [None req-7076a49d-a264-44c9-af10-f68e29d14598 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:13:23.087734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.088227 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.088826 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.089450 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.090659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.091271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.091767 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.092372 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.092971 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.093821 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.094197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.094548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c700f729c0 pid: 121232 (default app) Aug 10 17:13:23.094828 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.095437 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.096036 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.096640 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.097240 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.097845 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.098477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.099082 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.099683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.100293 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.100887 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.101486 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.102110 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.102762 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.103377 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.103975 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.104609 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.105371 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.105881 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.106518 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.107121 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.107748 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.108348 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.108945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.109561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.110133 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.110761 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.111386 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.111982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.112582 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.113205 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.113817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.114456 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.115066 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.115672 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.116273 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.116874 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.117475 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.118074 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.118699 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.119314 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.119946 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.120554 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.122223 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.122858 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.123491 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 17:13:23.124149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.124782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.125453 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.126072 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.126769 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.127414 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.128036 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.128659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.129259 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.129903 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.130560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.131159 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.131775 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.132406 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.132990 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.133637 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.134258 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.134924 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.135542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.136141 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.137297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.138118 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.139035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.139603 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.140229 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.140843 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.141391 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.142008 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.142642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.143234 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.143835 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.144443 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.145058 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.145690 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.146298 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.146950 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.147554 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.148154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.148763 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.149369 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.149985 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.150664 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.151285 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.151904 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.153032 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.153666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.154281 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.155012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.155634 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.156239 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.156850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.157452 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.158071 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.158689 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.159319 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.159953 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.160567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.161208 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.161805 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.162443 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.163041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.163651 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.164245 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.164866 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.165488 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.166088 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.166759 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.167370 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.168006 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.168643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.169246 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.169849 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.170496 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.171105 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.171716 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.172322 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.172927 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.173539 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.174138 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.174797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.175448 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.176095 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.176705 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.177343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.177983 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.178640 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.179240 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.179859 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.180464 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.181061 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.181663 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.182273 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.182908 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.184520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.185122 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.185725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.186325 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.186998 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.187613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.188215 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.188815 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.189415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.190095 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.190727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.191389 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.192038 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.192665 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.193294 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.193914 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.194588 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.195196 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.195817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.196437 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.197049 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.197680 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.198214 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.198803 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.199482 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.200128 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.200747 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.201381 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.201990 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.202642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.203309 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.203953 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.204570 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.205207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.205820 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.206489 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.207098 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.207709 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.208320 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.208937 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.209571 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.210184 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.210836 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.211444 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.212087 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.212697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.213324 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.213923 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.215387 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.216043 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.216714 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.217342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.217975 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.218637 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.219246 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.219888 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.220509 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.221111 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.221718 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.222329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.222969 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.223579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.224189 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.224804 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.225424 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.226033 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.226676 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.227309 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.227899 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.228547 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.229163 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.229790 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.231341 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.231945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.232548 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.233190 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.233808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.234440 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.235049 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.235690 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.236360 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.236945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.237546 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.238175 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.238830 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.242659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.242659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.242659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.242659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.242659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.242659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.243148 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.243642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.244251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.244860 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.245485 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.246140 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.246769 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.247370 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.247978 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.248574 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.249190 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.249817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.250960 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.251605 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.252221 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.252840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.253469 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.254083 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.254760 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.255388 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.256051 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.256649 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.257267 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.257900 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.258499 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.259120 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.259722 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.260323 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.260923 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.262036 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.262675 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.263281 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.264147 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.264745 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.265371 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.265973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.266633 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.267235 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.267875 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.268475 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.269057 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.269666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.270259 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.270971 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.271574 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.272226 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.272863 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.273524 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.274126 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.274773 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.275415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.276103 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.276707 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.277835 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.278475 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.279083 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.279683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.280303 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.280912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.281523 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.282121 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.282795 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.283362 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.283964 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.284574 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.285181 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.285771 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.286369 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.291178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.291178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.291178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.291178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.291178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.291178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.291178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.291178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.291937 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.292269 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.293463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.294295 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.294962 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.295657 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.296176 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.296785 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.297395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.298010 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.298644 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.299252 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.299890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.300510 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.301108 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.301722 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.302324 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.302952 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.303550 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.304167 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.304762 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.305363 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.305964 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.306600 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.307215 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.307858 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.308510 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.309067 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.309669 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.310277 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.314157 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.314157 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.314157 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.314157 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.314157 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.314157 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.314737 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.315354 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.315968 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.316571 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.317186 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.317809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.318452 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.319056 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.319655 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.320288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.320903 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.321512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.322143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.322806 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.323442 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.324098 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.324677 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.325292 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.325902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.326552 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.327162 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.327779 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.328398 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.329015 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.329589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.330196 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.330829 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.331447 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.332056 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.332660 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.333302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.333914 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.334556 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.335167 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.335768 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.340251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.340251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.340251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.340251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.340251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.340251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.340842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.341300 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.341920 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.342567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.343181 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.343997 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.344612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.345226 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.345839 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.346471 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.347073 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.347695 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.348334 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.348947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.349547 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.350147 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.350810 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.351403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.352014 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.352832 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.353444 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.354051 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.354893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.356059 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.356676 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.357319 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.357951 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.358619 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.359214 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.359835 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.360444 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.361082 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.361719 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.362334 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.362980 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.363585 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.364216 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.364855 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.365473 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.366112 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.366960 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.367596 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.368208 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.368833 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.369464 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.370066 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.370686 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.371439 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.372040 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.372644 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.373270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.373866 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.374480 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.375132 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.375739 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.376339 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.376939 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.377583 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.378179 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.378917 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.379538 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.380166 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.380788 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.381387 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.382020 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.382681 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.383286 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.383889 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.384485 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.385152 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.385757 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.387105 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.387766 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.388674 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.389282 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.389932 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.390622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.391246 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.391867 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.392497 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.393094 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.393695 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.394306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.394935 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.395532 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.396133 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.396720 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.397310 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.397921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.398564 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.399192 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.399798 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.400423 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.401036 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.401637 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.403006 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.403610 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.404274 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.404879 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.405517 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.406121 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.406794 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.407427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.408047 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.408676 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.409293 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.409931 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.410573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.411196 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.422717 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.422717 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.422717 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.422717 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.422717 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.422717 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.422717 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.422717 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.423523 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.423523 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.423523 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.423523 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.423523 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.423523 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.423523 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.423523 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.424116 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.424116 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.424116 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.424496 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.425117 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.425739 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.426371 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.427080 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.427690 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.428267 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.428862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.429466 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.430083 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.430712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.431282 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.431862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.432426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.433001 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.434171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.434784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.435394 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.436044 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.436683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.437292 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.437899 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.438573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.439164 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.440162 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.440773 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.441420 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.442053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.442717 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.443342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.443957 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.444588 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.445194 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.445787 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.446425 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.447034 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.447636 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.448256 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.448896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.449715 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.450343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.450987 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.452025 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.452698 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.453319 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.453962 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.454573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.455201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.455804 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.456431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.457033 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.457638 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.458256 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.458902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.459496 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.460102 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.460703 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.461306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.461902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.462541 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.463137 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.463773 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.464377 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.465201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.465803 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.466450 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.467051 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.467623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.468225 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.468825 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.469442 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.470039 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.470696 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.471295 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.471913 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.472508 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.473118 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.473719 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.474373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.474984 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.475648 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.476270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.476879 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.477512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.478135 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.478800 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.479475 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.480093 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.481180 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.481827 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.482488 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.484174 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.485004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.485618 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.486220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.486860 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.487490 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.488100 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.488716 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.489332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.489944 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.490588 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.491162 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.491779 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.492395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.493002 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.493605 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.494219 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.494862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.495475 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.496649 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.497270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.497933 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.498586 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.499205 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.499832 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.500453 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.501058 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.501664 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.502268 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.502902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.503521 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.504163 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.504774 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.505371 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.506203 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.506854 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.507474 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.508105 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.508709 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.509338 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.509981 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.510619 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.511246 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.511881 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.512523 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.513148 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.514048 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.514719 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.515320 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.515923 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.516521 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.517131 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.517749 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.518368 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.518973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.519576 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.520186 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.520791 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.521390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.521994 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.522626 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.523230 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.523830 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.524433 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.525034 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.525631 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.526229 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.526868 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.527721 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.528325 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.528930 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.529538 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.530141 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.530782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.531433 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.532081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.532694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.533384 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.533944 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.534577 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.535191 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.535824 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.536458 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.537076 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.537685 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.538329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.538972 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.539603 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.540211 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.540824 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.541430 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.542046 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.543302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.543947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.544549 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.545181 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.545802 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.546464 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.547083 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.547695 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.548357 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.549020 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.549573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.550179 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.550829 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.551439 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.552057 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.552669 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.553281 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.553871 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.554524 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.555166 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.555805 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.556414 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.557051 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.557695 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.558954 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.559749 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.560418 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.561052 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.561670 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.562284 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.562917 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 17:13:23.563389 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 17:13:23.834591 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO dbcounter [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] Registered counter for database nova_api Aug 10 17:13:23.866565 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_db.sqlalchemy.engines [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:13:23.879235 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writer thread running {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:13:23.994925 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.context [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),180adeb5-bada-47d6-898d-063cb32f2e64(cell1) {{(pid=121231) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 17:13:24.003787 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:13:24.004600 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:13:24.007936 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:13:24.009301 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:13:24.010145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:13:24.015434 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:13:24.019357 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO dbcounter [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] Registered counter for database nova_cell0 Aug 10 17:13:24.027748 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO dbcounter [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] Registered counter for database nova_cell1 Aug 10 17:13:24.039160 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_db.sqlalchemy.engines [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:13:24.041211 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_db.sqlalchemy.engines [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:13:24.047968 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writer thread running {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:13:24.051066 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writer thread running {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:13:24.207015 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO dbcounter [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] Registered counter for database nova_cell0 Aug 10 17:13:24.214112 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_db.sqlalchemy.engines [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 17:13:24.219924 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writer thread running {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 17:13:24.557233 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: WARNING keystonemiddleware.auth_token [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:13:24.564965 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: WARNING keystonemiddleware.auth_token [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:13:24.927280 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: WARNING keystonemiddleware.auth_token [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 17:13:24.933396 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: WARNING keystonemiddleware.auth_token [None req-ef39a2f2-d7e4-4db2-95dc-24ad89636f73 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 17:13:24.939667 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c700f729c0 pid: 121231 (default app) Aug 10 17:13:59.637032 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:13:59.639541 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:13:59.641446 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:13:59.643720 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:01.328027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7d801421-3ae4-4380-9bb9-860d6a5a276d tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] Action: 'create', calling method: .version_select at 0x7f7ebc06de50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1425295780", "metadata": {"Type": "work"}}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:03.144904 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:03.146047 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:03.147070 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:03.148178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:04.127245 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1eee485b-f27a-47ee-b326-d6afa5764f34 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Action: 'create', calling method: .version_select at 0x7f7ebbf95d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-190482350", "metadata": {"Type": "work"}}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1eee485b-f27a-47ee-b326-d6afa5764f34 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Request method failure captured: Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 121 Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-dag3iWEBW5bIE-oj9lspibCE0rHCVHQ4R_FoBYKP4cJNWLv-tY25VnMv7oO50PBVB8PGDB8mUGzgH8avO4sPY6U_XKdE8GBX9kPTRKc6pi2DS_MA_Qiw1o87ojjbOKptjBOb-NVu8O1bQS2qSWkG4A_0ji6NMNBikVMX-aRPQHCK8 Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: eaff929dc8a54995bc2eb72576e01495 Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:14:04.155035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:14:04.156942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eaff929dc8a54995bc2eb72576e01495", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eaff929dc8a54995bc2eb72576e01495"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eaff929dc8a54995bc2eb72576e01495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eaff929dc8a54995bc2eb72576e01495"}]}] Aug 10 17:14:04.156942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:04.156942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: eaff929dc8a54995bc2eb72576e01495 Aug 10 17:14:04.156942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:04.156942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesNegativeTest-1644108592-project Aug 10 17:14:04.156942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:14:04.156942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:14:04.156942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: de21b7ddd7f543fe895e94ac57e11f81 Aug 10 17:14:04.156942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesNegativeTest-1644108592-project Aug 10 17:14:04.156942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Aug 10 17:14:04.156942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-190482350", "metadata": {"Type": "work"}}} Aug 10 17:14:04.156942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: Aug 10 17:14:04.156942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-190482350', 'metadata': {'Type': 'work'}}}} Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:14:04.157776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:14:04.159207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:14:04.160372 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 17:14:04.160372 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.161726 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1eee485b-f27a-47ee-b326-d6afa5764f34 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:14:04.167584 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1eee485b-f27a-47ee-b326-d6afa5764f34 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.023974 Aug 10 17:14:04.174974 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 10 17:14:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1037 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:14:04.197673 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-029d6406-89c4-44cc-9cb3-101b102127fd tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Action: 'create', calling method: .version_select at 0x7f7ebbfb2820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1269645330", "metadata": {"Type": "work"}}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-029d6406-89c4-44cc-9cb3-101b102127fd tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Request method failure captured: Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 120 Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-dag3iWEBW5bIE-oj9lspibCE0rHCVHQ4R_FoBYKP4cJNWLv-tY25VnMv7oO50PBVB8PGDB8mUGzgH8avO4sPY6U_XKdE8GBX9kPTRKc6pi2DS_MA_Qiw1o87ojjbOKptjBOb-NVu8O1bQS2qSWkG4A_0ji6NMNBikVMX-aRPQHCK8 Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: eaff929dc8a54995bc2eb72576e01495 Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:14:04.212380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:14:04.215735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eaff929dc8a54995bc2eb72576e01495", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eaff929dc8a54995bc2eb72576e01495"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eaff929dc8a54995bc2eb72576e01495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eaff929dc8a54995bc2eb72576e01495"}]}] Aug 10 17:14:04.215735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:04.215735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: eaff929dc8a54995bc2eb72576e01495 Aug 10 17:14:04.215735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:04.215735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesNegativeTest-1644108592-project Aug 10 17:14:04.215735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:14:04.215735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:14:04.215735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: de21b7ddd7f543fe895e94ac57e11f81 Aug 10 17:14:04.215735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesNegativeTest-1644108592-project Aug 10 17:14:04.215735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Aug 10 17:14:04.215735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1269645330", "metadata": {"Type": "work"}}} Aug 10 17:14:04.215735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: Aug 10 17:14:04.215735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1269645330', 'metadata': {'Type': 'work'}}}} Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi '0' Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:14:04.217590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:14:04.221890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:14:04.229210 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 17:14:04.229210 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.229210 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-029d6406-89c4-44cc-9cb3-101b102127fd tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:14:04.229210 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-029d6406-89c4-44cc-9cb3-101b102127fd tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033226 Aug 10 17:14:04.229210 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 2/2] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 10 17:14:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 17:14:04.236436 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-960e2f38-00ce-4257-9d6d-75f459fa5426 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Action: 'create', calling method: .version_select at 0x7f7ebbe4e8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-853909311", "metadata": {"Type": "work"}}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-960e2f38-00ce-4257-9d6d-75f459fa5426 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Request method failure captured: Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 118 Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-dag3iWEBW5bIE-oj9lspibCE0rHCVHQ4R_FoBYKP4cJNWLv-tY25VnMv7oO50PBVB8PGDB8mUGzgH8avO4sPY6U_XKdE8GBX9kPTRKc6pi2DS_MA_Qiw1o87ojjbOKptjBOb-NVu8O1bQS2qSWkG4A_0ji6NMNBikVMX-aRPQHCK8 Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: eaff929dc8a54995bc2eb72576e01495 Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:14:04.240895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:14:04.243559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eaff929dc8a54995bc2eb72576e01495", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eaff929dc8a54995bc2eb72576e01495"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eaff929dc8a54995bc2eb72576e01495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eaff929dc8a54995bc2eb72576e01495"}]}] Aug 10 17:14:04.243559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:04.243559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: eaff929dc8a54995bc2eb72576e01495 Aug 10 17:14:04.243559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:04.243559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesNegativeTest-1644108592-project Aug 10 17:14:04.243559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:14:04.243559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:14:04.243559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: de21b7ddd7f543fe895e94ac57e11f81 Aug 10 17:14:04.243559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesNegativeTest-1644108592-project Aug 10 17:14:04.243559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Aug 10 17:14:04.243559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-853909311", "metadata": {"Type": "work"}}} Aug 10 17:14:04.243559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: Aug 10 17:14:04.243559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-853909311', 'metadata': {'Type': 'work'}}}} Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise error Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi '' Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:14:04.245862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 17:14:04.254127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 17:14:04.260355 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 17:14:04.260355 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.260355 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-960e2f38-00ce-4257-9d6d-75f459fa5426 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:14:04.260355 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-960e2f38-00ce-4257-9d6d-75f459fa5426 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014646 Aug 10 17:14:04.260355 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 3/3] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 10 17:14:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:14:04.267744 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ddb86849-9449-4c67-9f9c-27503f013ba7 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Calling method '.version_select at 0x7f7ebbe4e5e0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:04.660148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7d801421-3ae4-4380-9bb9-860d6a5a276d tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 5.056688 Aug 10 17:14:04.662185 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 1/4] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 10 17:13:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 5061 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 10 17:14:04.690431 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e664c69e-5b3b-4038-b642-9fb4706fc877 tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] Calling method '.version_select at 0x7f7ebbeb0ca0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:04.978663 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-ddb86849-9449-4c67-9f9c-27503f013ba7 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] HTTP exception thrown: Volume tempest-invalid-202245752 could not be found. Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ddb86849-9449-4c67-9f9c-27503f013ba7 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Request method failure captured: Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-202245752 HTTP/1.1 Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-dag3iWEBW5bIE-oj9lspibCE0rHCVHQ4R_FoBYKP4cJNWLv-tY25VnMv7oO50PBVB8PGDB8mUGzgH8avO4sPY6U_XKdE8GBX9kPTRKc6pi2DS_MA_Qiw1o87ojjbOKptjBOb-NVu8O1bQS2qSWkG4A_0ji6NMNBikVMX-aRPQHCK8 Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: eaff929dc8a54995bc2eb72576e01495 Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:14:04.983463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:14:04.986142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eaff929dc8a54995bc2eb72576e01495", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eaff929dc8a54995bc2eb72576e01495"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eaff929dc8a54995bc2eb72576e01495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eaff929dc8a54995bc2eb72576e01495"}]}] Aug 10 17:14:04.986142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:04.986142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: eaff929dc8a54995bc2eb72576e01495 Aug 10 17:14:04.986142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:04.986142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesNegativeTest-1644108592-project Aug 10 17:14:04.986142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:14:04.986142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:14:04.986142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: de21b7ddd7f543fe895e94ac57e11f81 Aug 10 17:14:04.986142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesNegativeTest-1644108592-project Aug 10 17:14:04.986142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: Aug 10 17:14:04.986142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Volume tempest-invalid-202245752 could not be found. Aug 10 17:14:04.986142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': 'tempest-invalid-202245752'} Aug 10 17:14:04.986142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-202245752 could not be found. (HTTP 404) (Request-ID: req-8a8c9db7-35c8-4342-bbee-5a5671801fb9) Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:04.987853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 17:14:04.989306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-202245752 could not be found. Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:14:04.991642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-202245752 could not be found. Aug 10 17:14:04.994270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.994270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:04.994270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.994270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:04.994270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:14:04.994270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:14:04.994270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:14:04.994270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:14:04.994270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-202245752 could not be found. Aug 10 17:14:04.994270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:04.994270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ddb86849-9449-4c67-9f9c-27503f013ba7 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Returning 404 to user: Volume tempest-invalid-202245752 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:14:04.994270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ddb86849-9449-4c67-9f9c-27503f013ba7 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-202245752" status: 404 len: 98 microversion: 2.1 time: 0.730788 Aug 10 17:14:04.994270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 4/5] 10.222.0.45 () {58 vars in 1215 bytes} [Wed Aug 10 17:14:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-202245752 => generated 98 bytes in 739 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:14:05.004164 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-956bda6b-7402-4e43-9dd3-55275a4a3fa3 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008457 Aug 10 17:14:05.013210 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 5/6] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Aug 10 17:14:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 17:14:05.028334 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c586271e-3d33-4420-9b88-91e90c1a95fe tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011180 Aug 10 17:14:05.033603 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 6/7] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Aug 10 17:14:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 17:14:05.044709 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4d520308-665f-4e2c-9272-e78046153b6d tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Calling method '.version_select at 0x7f7ebbd84c10>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:05.050975 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e664c69e-5b3b-4038-b642-9fb4706fc877 tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/056a3f2a-3ef5-4635-83ad-7bfef57fd7c5" status: 200 len: 353 microversion: 2.1 time: 0.371277 Aug 10 17:14:05.062130 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 2/8] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:14:04 2022] GET /compute/v2.1/os-volumes/056a3f2a-3ef5-4635-83ad-7bfef57fd7c5 => generated 353 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:14:05.105334 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-4d520308-665f-4e2c-9272-e78046153b6d tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] HTTP exception thrown: Volume 78eaf9fd-64be-403b-8022-1bec76e02790 could not be found. Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4d520308-665f-4e2c-9272-e78046153b6d tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Request method failure captured: Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/os-volumes/78eaf9fd-64be-403b-8022-1bec76e02790 HTTP/1.1 Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-dag3iWEBW5bIE-oj9lspibCE0rHCVHQ4R_FoBYKP4cJNWLv-tY25VnMv7oO50PBVB8PGDB8mUGzgH8avO4sPY6U_XKdE8GBX9kPTRKc6pi2DS_MA_Qiw1o87ojjbOKptjBOb-NVu8O1bQS2qSWkG4A_0ji6NMNBikVMX-aRPQHCK8 Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: eaff929dc8a54995bc2eb72576e01495 Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:14:05.108947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:14:05.111883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eaff929dc8a54995bc2eb72576e01495", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eaff929dc8a54995bc2eb72576e01495"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eaff929dc8a54995bc2eb72576e01495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eaff929dc8a54995bc2eb72576e01495"}]}] Aug 10 17:14:05.111883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:05.111883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: eaff929dc8a54995bc2eb72576e01495 Aug 10 17:14:05.111883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:05.111883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesNegativeTest-1644108592-project Aug 10 17:14:05.111883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:14:05.111883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:14:05.111883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: de21b7ddd7f543fe895e94ac57e11f81 Aug 10 17:14:05.111883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesNegativeTest-1644108592-project Aug 10 17:14:05.111883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: Aug 10 17:14:05.111883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Volume 78eaf9fd-64be-403b-8022-1bec76e02790 could not be found. Aug 10 17:14:05.111883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': '78eaf9fd-64be-403b-8022-1bec76e02790'} Aug 10 17:14:05.111883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 78eaf9fd-64be-403b-8022-1bec76e02790 could not be found. (HTTP 404) (Request-ID: req-8bd94c88-cb4c-4465-b50e-4c5e279d8a53) Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:05.113431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 17:14:05.119417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 78eaf9fd-64be-403b-8022-1bec76e02790 could not be found. Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 17:14:05.123012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:14:05.126991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 78eaf9fd-64be-403b-8022-1bec76e02790 could not be found. Aug 10 17:14:05.126991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:05.126991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:05.126991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:05.126991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:05.126991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:14:05.126991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:14:05.126991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:14:05.126991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:14:05.126991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 78eaf9fd-64be-403b-8022-1bec76e02790 could not be found. Aug 10 17:14:05.126991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:05.126991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4d520308-665f-4e2c-9272-e78046153b6d tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Returning 404 to user: Volume 78eaf9fd-64be-403b-8022-1bec76e02790 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:14:05.126991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4d520308-665f-4e2c-9272-e78046153b6d tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/78eaf9fd-64be-403b-8022-1bec76e02790" status: 404 len: 109 microversion: 2.1 time: 0.077038 Aug 10 17:14:05.126991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 7/9] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 17:14:05 2022] DELETE /compute/v2.1/os-volumes/78eaf9fd-64be-403b-8022-1bec76e02790 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ea9907c9-be48-4ea8-b071-76c7a72d4a51 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Calling method '.version_select at 0x7f7ebbe4f3a0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-ea9907c9-be48-4ea8-b071-76c7a72d4a51 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] HTTP exception thrown: Volume ad28b3ab-b3bb-4deb-b92b-b2f11d8b711f could not be found. Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ea9907c9-be48-4ea8-b071-76c7a72d4a51 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Request method failure captured: Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/os-volumes/ad28b3ab-b3bb-4deb-b92b-b2f11d8b711f HTTP/1.1 Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-dag3iWEBW5bIE-oj9lspibCE0rHCVHQ4R_FoBYKP4cJNWLv-tY25VnMv7oO50PBVB8PGDB8mUGzgH8avO4sPY6U_XKdE8GBX9kPTRKc6pi2DS_MA_Qiw1o87ojjbOKptjBOb-NVu8O1bQS2qSWkG4A_0ji6NMNBikVMX-aRPQHCK8 Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: eaff929dc8a54995bc2eb72576e01495 Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:14:05.392356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:14:05.403956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eaff929dc8a54995bc2eb72576e01495", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eaff929dc8a54995bc2eb72576e01495"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eaff929dc8a54995bc2eb72576e01495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eaff929dc8a54995bc2eb72576e01495"}]}] Aug 10 17:14:05.403956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:05.403956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: eaff929dc8a54995bc2eb72576e01495 Aug 10 17:14:05.403956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesNegativeTest-1644108592 Aug 10 17:14:05.403956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesNegativeTest-1644108592-project Aug 10 17:14:05.403956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:14:05.403956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:14:05.403956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: de21b7ddd7f543fe895e94ac57e11f81 Aug 10 17:14:05.403956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesNegativeTest-1644108592-project Aug 10 17:14:05.403956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: Aug 10 17:14:05.403956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Volume ad28b3ab-b3bb-4deb-b92b-b2f11d8b711f could not be found. Aug 10 17:14:05.403956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': 'ad28b3ab-b3bb-4deb-b92b-b2f11d8b711f'} Aug 10 17:14:05.403956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad28b3ab-b3bb-4deb-b92b-b2f11d8b711f could not be found. (HTTP 404) (Request-ID: req-a3019cd3-5bb8-473e-be1c-9a6d01f543ec) Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:05.410330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 17:14:05.415977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad28b3ab-b3bb-4deb-b92b-b2f11d8b711f could not be found. Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 17:14:05.422345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:14:05.428980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad28b3ab-b3bb-4deb-b92b-b2f11d8b711f could not be found. Aug 10 17:14:05.428980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:14:05.428980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:05.428980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:14:05.428980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:05.428980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:14:05.428980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:14:05.428980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:14:05.428980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:14:05.428980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad28b3ab-b3bb-4deb-b92b-b2f11d8b711f could not be found. Aug 10 17:14:05.428980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:14:05.428980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ea9907c9-be48-4ea8-b071-76c7a72d4a51 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] Returning 404 to user: Volume ad28b3ab-b3bb-4deb-b92b-b2f11d8b711f could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:14:05.428980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ea9907c9-be48-4ea8-b071-76c7a72d4a51 tempest-VolumesNegativeTest-1644108592 tempest-VolumesNegativeTest-1644108592-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ad28b3ab-b3bb-4deb-b92b-b2f11d8b711f" status: 404 len: 109 microversion: 2.1 time: 0.109419 Aug 10 17:14:05.428980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 3/10] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:14:05 2022] GET /compute/v2.1/os-volumes/ad28b3ab-b3bb-4deb-b92b-b2f11d8b711f => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:14:06.074243 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-beacedc4-ad03-4e20-9462-e3f0d3d5080e tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] Calling method '.version_select at 0x7f7ebbd84dc0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:06.251222 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-beacedc4-ad03-4e20-9462-e3f0d3d5080e tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/056a3f2a-3ef5-4635-83ad-7bfef57fd7c5" status: 200 len: 354 microversion: 2.1 time: 0.184178 Aug 10 17:14:06.252712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 8/11] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:14:06 2022] GET /compute/v2.1/os-volumes/056a3f2a-3ef5-4635-83ad-7bfef57fd7c5 => generated 354 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:14:06.279041 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f829cf4a-f66d-48c6-9fe8-d7e92a32b6ee tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] Calling method '.version_select at 0x7f7ebbdb64c0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:06.570954 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f829cf4a-f66d-48c6-9fe8-d7e92a32b6ee tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/056a3f2a-3ef5-4635-83ad-7bfef57fd7c5" status: 200 len: 354 microversion: 2.1 time: 0.299815 Aug 10 17:14:06.582386 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 4/12] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:14:06 2022] GET /compute/v2.1/os-volumes/056a3f2a-3ef5-4635-83ad-7bfef57fd7c5 => generated 354 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:14:06.622543 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-04fa46b0-9c8a-4c4f-9498-823cad0be7bd tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] Calling method '.version_select at 0x7f7ebbd95040>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:07.020562 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-04fa46b0-9c8a-4c4f-9498-823cad0be7bd tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/056a3f2a-3ef5-4635-83ad-7bfef57fd7c5" status: 202 len: 0 microversion: 2.1 time: 0.422487 Aug 10 17:14:07.021435 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 9/13] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 17:14:06 2022] DELETE /compute/v2.1/os-volumes/056a3f2a-3ef5-4635-83ad-7bfef57fd7c5 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:14:07.035726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a5b1fc58-69e8-4115-b1a4-523077322966 tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] Calling method '.version_select at 0x7f7ebbdb6b80>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:07.155961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a5b1fc58-69e8-4115-b1a4-523077322966 tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/056a3f2a-3ef5-4635-83ad-7bfef57fd7c5" status: 200 len: 353 microversion: 2.1 time: 0.126819 Aug 10 17:14:07.168782 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 5/14] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:14:07 2022] GET /compute/v2.1/os-volumes/056a3f2a-3ef5-4635-83ad-7bfef57fd7c5 => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:14:08.176127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ed293dee-f8de-493f-af79-a760907acdb1 tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] Calling method '.version_select at 0x7f7ebbd849d0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:08.227136 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-ed293dee-f8de-493f-af79-a760907acdb1 tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] HTTP exception thrown: Volume 056a3f2a-3ef5-4635-83ad-7bfef57fd7c5 could not be found. Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ed293dee-f8de-493f-af79-a760907acdb1 tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] Request method failure captured: Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/os-volumes/056a3f2a-3ef5-4635-83ad-7bfef57fd7c5 HTTP/1.1 Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-dXp3LppoAAMDoha9LCsO7BjR0weUEtuR6cqN6IxOWAIxfNRn3AG5tsQ_54OUNl60Zm3e8Ftuo3kvwV9NjXc4fhBFVVM-0yfU4_0X8LHsuUB0YSKlEKGIrUV5Hbik4XQn3JESPJYanhAaNJ-1bBBWH7R9Qowt2QQzAUzHsd5ZE2S_w Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: 651ed58528604503882d8c2fa3313a73 Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesGetTestJSON-2068859411 Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:14:08.230612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:14:08.231852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_651ed58528604503882d8c2fa3313a73", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/651ed58528604503882d8c2fa3313a73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/651ed58528604503882d8c2fa3313a73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/651ed58528604503882d8c2fa3313a73"}]}] Aug 10 17:14:08.231852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesGetTestJSON-2068859411 Aug 10 17:14:08.231852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 651ed58528604503882d8c2fa3313a73 Aug 10 17:14:08.231852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesGetTestJSON-2068859411 Aug 10 17:14:08.231852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesGetTestJSON-2068859411-project Aug 10 17:14:08.231852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:14:08.231852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:14:08.231852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: e08cf8c5e0a0497d80afae2f02a24972 Aug 10 17:14:08.231852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesGetTestJSON-2068859411-project Aug 10 17:14:08.231852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: Aug 10 17:14:08.231852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Volume 056a3f2a-3ef5-4635-83ad-7bfef57fd7c5 could not be found. Aug 10 17:14:08.231852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': '056a3f2a-3ef5-4635-83ad-7bfef57fd7c5'} Aug 10 17:14:08.231852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 056a3f2a-3ef5-4635-83ad-7bfef57fd7c5 could not be found. (HTTP 404) (Request-ID: req-e1b39ab5-af96-4e9e-a457-48dc97694416) Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:08.232602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 17:14:08.233606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 056a3f2a-3ef5-4635-83ad-7bfef57fd7c5 could not be found. Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 17:14:08.234683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:14:08.235727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 056a3f2a-3ef5-4635-83ad-7bfef57fd7c5 could not be found. Aug 10 17:14:08.235727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:08.235727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:14:08.235727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:08.235727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:14:08.235727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:14:08.235727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:14:08.235727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:14:08.235727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:14:08.235727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 056a3f2a-3ef5-4635-83ad-7bfef57fd7c5 could not be found. Aug 10 17:14:08.235727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:14:08.235727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ed293dee-f8de-493f-af79-a760907acdb1 tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] Returning 404 to user: Volume 056a3f2a-3ef5-4635-83ad-7bfef57fd7c5 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:14:08.235727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ed293dee-f8de-493f-af79-a760907acdb1 tempest-VolumesGetTestJSON-2068859411 tempest-VolumesGetTestJSON-2068859411-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/056a3f2a-3ef5-4635-83ad-7bfef57fd7c5" status: 404 len: 109 microversion: 2.1 time: 0.060506 Aug 10 17:14:08.236431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 10/15] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:14:08 2022] GET /compute/v2.1/os-volumes/056a3f2a-3ef5-4635-83ad-7bfef57fd7c5 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:14:21.349422 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1324138273", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:21.770519 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] validate_networks() for [('adf93d4a-df17-4d5a-8dd7-051408dfa629', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:14:24.553940 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:14:24.556804 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:14:24.557922 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:14:24.558723 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:14:24.560078 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:14:24.674449 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:24.677738 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:24.686811 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:24.688453 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:24.689295 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:24.698684 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:24.834280 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Getting quotas for project 2eb3ea42180f4a0ca5ca3c90962fb301. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:14:24.853380 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Getting quotas for user 7d2a65984c4f42fbb18977c7345c42ce and project 2eb3ea42180f4a0ca5ca3c90962fb301. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:14:24.893826 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:14:24.904233 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:14:25.251078 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1333163d-6efc-4ef2-9b1f-16d063a1c0b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.253137 Aug 10 17:14:25.252521 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 6/16] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:14:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 4256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:14:25.271040 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8fcf19a4-ee70-4beb-ab85-81bf3020c59d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:25.272486 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8fcf19a4-ee70-4beb-ab85-81bf3020c59d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:25.850808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8fcf19a4-ee70-4beb-ab85-81bf3020c59d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:25.886172 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8fcf19a4-ee70-4beb-ab85-81bf3020c59d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1222 microversion: 2.1 time: 0.618250 Aug 10 17:14:25.888197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 11/17] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:25 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1222 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:26.326212 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1097776312", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:26.495685 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] validate_networks() for [('adf93d4a-df17-4d5a-8dd7-051408dfa629', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:14:27.476728 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-642124158", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "networks": [{"uuid": "4e3f48c5-0110-4c42-967c-afd072f7b5e0"}]}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:27.970398 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] validate_networks() for [('4e3f48c5-0110-4c42-967c-afd072f7b5e0', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:14:30.201196 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:14:30.201196 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:14:30.201196 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:14:30.201854 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:14:30.201854 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:14:30.221073 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:30.221585 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:30.222043 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:30.227362 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:30.227869 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:30.228516 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:30.308274 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Getting quotas for project 2eb3ea42180f4a0ca5ca3c90962fb301. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:14:30.317955 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Getting quotas for user 7d2a65984c4f42fbb18977c7345c42ce and project 2eb3ea42180f4a0ca5ca3c90962fb301. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:14:30.346939 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:14:30.349522 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:14:30.452793 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:14:30.453512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:14:30.453646 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:14:30.453958 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:14:30.454604 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:14:30.491606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:30.492431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:30.493436 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:30.497272 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:30.498906 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:30.502456 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:30.519898 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b4d215f3-114d-4448-b55c-e8c81a3684d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.226343 Aug 10 17:14:30.533059 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 7/18] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:14:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 4243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:14:30.591366 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Getting quotas for project 8a7cd3e7d80845e89b398f0707097ffd. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:14:30.603813 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Getting quotas for user 06cb7a8f70ab409b86c669620df4a651 and project 8a7cd3e7d80845e89b398f0707097ffd. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:14:30.648583 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:14:30.660764 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:14:30.987989 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-147f567a-e2aa-4276-9306-2d13cc36428e tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.861327 Aug 10 17:14:30.988924 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 12/19] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:14:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 17:14:31.007524 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0692182a-b465-48c2-af46-3c3262af3c27 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:31.008423 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0692182a-b465-48c2-af46-3c3262af3c27 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:31.285607 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0692182a-b465-48c2-af46-3c3262af3c27 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:31.293757 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0692182a-b465-48c2-af46-3c3262af3c27 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1222 microversion: 2.1 time: 0.303118 Aug 10 17:14:31.299630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 13/20] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:30 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1222 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:31.304711 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cfdc6720-3d88-4e6b-8e00-c5d1714d667a tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:31.318743 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cfdc6720-3d88-4e6b-8e00-c5d1714d667a tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:31.633134 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d9e50124-e18d-4225-8f4b-5b71005b5bc1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Action: 'create', calling method: .version_select at 0x7f7ebb4b3670>, body: {"keypair": {"name": "tempest-keypair-1503583688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8xRNJ9MVDJqdQ64zozP/D1VSCs9VNylOF5EjJFRQWej+Ra9vZcSiDNpWVT1UDTkEW2njlYgenwMNE8EbI0kZln5R33Y25sEeTFl0vzl/cTufNiGYNxfzgBiV3VzeXXug=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:31.748982 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-d9e50124-e18d-4225-8f4b-5b71005b5bc1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:14:31.759850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-d9e50124-e18d-4225-8f4b-5b71005b5bc1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for user 48feb2fc02f04e739c5e1bf7d68baa16 and project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:14:32.004556 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d9e50124-e18d-4225-8f4b-5b71005b5bc1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.467720 Aug 10 17:14:32.006396 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 8/21] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 17:14:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:14:32.118397 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cfdc6720-3d88-4e6b-8e00-c5d1714d667a tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:32.195626 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cfdc6720-3d88-4e6b-8e00-c5d1714d667a tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1214 microversion: 2.1 time: 0.891351 Aug 10 17:14:32.209433 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 14/22] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:31 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1214 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:32.328250 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9004ce9b-1a13-46ec-9d07-07ee18ca52e4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:32.332691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9004ce9b-1a13-46ec-9d07-07ee18ca52e4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:33.013928 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9004ce9b-1a13-46ec-9d07-07ee18ca52e4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:33.060761 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9004ce9b-1a13-46ec-9d07-07ee18ca52e4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1222 microversion: 2.1 time: 0.746781 Aug 10 17:14:33.064123 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 9/23] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:32 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1222 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:33.245648 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3642d9e2-50a4-4b41-850e-72a6e49f4f1c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:33.245648 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3642d9e2-50a4-4b41-850e-72a6e49f4f1c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:33.354942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3642d9e2-50a4-4b41-850e-72a6e49f4f1c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:33.381617 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3642d9e2-50a4-4b41-850e-72a6e49f4f1c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1214 microversion: 2.1 time: 0.139632 Aug 10 17:14:33.383072 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 15/24] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:33 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:33.766308 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-83dd2ed4-c7dd-4029-8c5a-8e3938e0442a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Action: 'create', calling method: .version_select at 0x7f7eba47c4c0>, body: {"keypair": {"name": "tempest-keypair-1792548518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjOuYhAdlqtVm8wAT0Z9BBMhSzfX6maMFx99NZN5c1VCu0y5FP/RuT1NH4KYeYw5wzDHJQStPw+b9kZjo1zkDXiajFdDqWkchAzBPkyOixUC3wcIlhE7s3Rh9yf4j1oWA=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:33.812850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-83dd2ed4-c7dd-4029-8c5a-8e3938e0442a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Getting quotas for project 7e92e1e1c27241798e336e547580be5e. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:14:33.827552 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-83dd2ed4-c7dd-4029-8c5a-8e3938e0442a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Getting quotas for user 2f74a20789dc4ef697861146252bacba and project 7e92e1e1c27241798e336e547580be5e. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:14:34.091032 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-83dd2ed4-c7dd-4029-8c5a-8e3938e0442a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.533560 Aug 10 17:14:34.098798 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 10/25] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 17:14:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:14:34.106122 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a0d77738-7730-48ea-af44-c01f70809139 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:34.107039 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a0d77738-7730-48ea-af44-c01f70809139 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:34.138884 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a0d77738-7730-48ea-af44-c01f70809139 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:34.143719 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a0d77738-7730-48ea-af44-c01f70809139 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:34.144833 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a0d77738-7730-48ea-af44-c01f70809139 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:34.148123 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a0d77738-7730-48ea-af44-c01f70809139 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:34.150045 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a0d77738-7730-48ea-af44-c01f70809139 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:34.158498 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a0d77738-7730-48ea-af44-c01f70809139 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:34.341346 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9516f984-0511-4ea4-8233-cde6f944ff8d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Action: 'create', calling method: .version_select at 0x7f7ebbcb0ca0>, body: {"keypair": {"name": "tempest-keypair-1314704727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9b3ZOPNtoKFnEkA/Q2Xl/IVWWuV11xepapq+rtW1R2g8DUpLEXPp8rn/n0ZeGUMob5pyAJi37Z9NFvN/DZZjnzu3J8R5ErqP/hFJ/lYRLNgmoma1HYrQcCc6OCTO/mag=="}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:34.500720 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-9516f984-0511-4ea4-8233-cde6f944ff8d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Getting quotas for project ed45fd312c58480f993616d451abcab7. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:14:34.527841 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-9516f984-0511-4ea4-8233-cde6f944ff8d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Getting quotas for user 5bf9229cd5d6429ea14249f8976e83cc and project ed45fd312c58480f993616d451abcab7. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:14:34.816828 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9516f984-0511-4ea4-8233-cde6f944ff8d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.750987 Aug 10 17:14:34.826652 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 16/26] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Aug 10 17:14:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 761 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 17:14:34.834452 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ea378ce0-898d-4fac-9cff-6b66bb756b27 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:34.835450 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ea378ce0-898d-4fac-9cff-6b66bb756b27 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:34.851306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea378ce0-898d-4fac-9cff-6b66bb756b27 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:34.854963 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea378ce0-898d-4fac-9cff-6b66bb756b27 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:34.858944 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea378ce0-898d-4fac-9cff-6b66bb756b27 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:34.859523 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea378ce0-898d-4fac-9cff-6b66bb756b27 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:34.860750 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea378ce0-898d-4fac-9cff-6b66bb756b27 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:34.861574 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea378ce0-898d-4fac-9cff-6b66bb756b27 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:35.492939 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ea378ce0-898d-4fac-9cff-6b66bb756b27 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:35.500034 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a0d77738-7730-48ea-af44-c01f70809139 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:35.513539 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ea378ce0-898d-4fac-9cff-6b66bb756b27 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1218 microversion: 2.1 time: 0.685679 Aug 10 17:14:35.514343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 17/27] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:34 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1218 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:35.530285 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a0d77738-7730-48ea-af44-c01f70809139 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1226 microversion: 2.1 time: 1.429195 Aug 10 17:14:35.555435 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 11/28] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:34 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1226 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:14:36.538961 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-da3dd455-132a-49a2-ab68-fb40f11239b9 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:36.540280 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-da3dd455-132a-49a2-ab68-fb40f11239b9 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:36.561441 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da3dd455-132a-49a2-ab68-fb40f11239b9 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:36.561668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bd418a9e-37a0-460e-985b-61981fbdc7fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:36.562104 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da3dd455-132a-49a2-ab68-fb40f11239b9 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:36.562245 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bd418a9e-37a0-460e-985b-61981fbdc7fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:36.562406 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da3dd455-132a-49a2-ab68-fb40f11239b9 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:36.563141 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da3dd455-132a-49a2-ab68-fb40f11239b9 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:36.563612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da3dd455-132a-49a2-ab68-fb40f11239b9 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:36.564224 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da3dd455-132a-49a2-ab68-fb40f11239b9 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:36.577838 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd418a9e-37a0-460e-985b-61981fbdc7fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:36.579060 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd418a9e-37a0-460e-985b-61981fbdc7fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:36.580462 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd418a9e-37a0-460e-985b-61981fbdc7fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:36.582900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd418a9e-37a0-460e-985b-61981fbdc7fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:36.584397 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd418a9e-37a0-460e-985b-61981fbdc7fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:36.584847 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd418a9e-37a0-460e-985b-61981fbdc7fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:37.358433 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bd418a9e-37a0-460e-985b-61981fbdc7fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:37.368183 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bd418a9e-37a0-460e-985b-61981fbdc7fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1282 microversion: 2.1 time: 0.810928 Aug 10 17:14:37.373728 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 12/29] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:36 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1282 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:14:37.486552 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-da3dd455-132a-49a2-ab68-fb40f11239b9 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:37.521600 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-da3dd455-132a-49a2-ab68-fb40f11239b9 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1274 microversion: 2.1 time: 0.986699 Aug 10 17:14:37.535893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 18/30] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:36 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1274 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:38.392491 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9c34d6b5-4644-4d85-bfae-f80566a9589d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:38.394077 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9c34d6b5-4644-4d85-bfae-f80566a9589d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:38.412621 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c34d6b5-4644-4d85-bfae-f80566a9589d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:38.413118 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c34d6b5-4644-4d85-bfae-f80566a9589d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:38.419180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c34d6b5-4644-4d85-bfae-f80566a9589d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:38.424817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c34d6b5-4644-4d85-bfae-f80566a9589d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:38.425950 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c34d6b5-4644-4d85-bfae-f80566a9589d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:38.426878 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c34d6b5-4644-4d85-bfae-f80566a9589d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:38.550055 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e0564287-82f2-4be9-ad5e-87cf372c5fdf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:38.550756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e0564287-82f2-4be9-ad5e-87cf372c5fdf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:38.578698 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0564287-82f2-4be9-ad5e-87cf372c5fdf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:38.579543 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0564287-82f2-4be9-ad5e-87cf372c5fdf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:38.581462 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0564287-82f2-4be9-ad5e-87cf372c5fdf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:38.585861 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0564287-82f2-4be9-ad5e-87cf372c5fdf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:38.586744 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0564287-82f2-4be9-ad5e-87cf372c5fdf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:38.587376 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0564287-82f2-4be9-ad5e-87cf372c5fdf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:39.013826 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e0564287-82f2-4be9-ad5e-87cf372c5fdf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:39.024510 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9c34d6b5-4644-4d85-bfae-f80566a9589d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:39.033808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e0564287-82f2-4be9-ad5e-87cf372c5fdf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1272 microversion: 2.1 time: 0.488453 Aug 10 17:14:39.036413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9c34d6b5-4644-4d85-bfae-f80566a9589d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1280 microversion: 2.1 time: 0.649259 Aug 10 17:14:39.038666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 19/31] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:38 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1272 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:14:39.074560 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 13/32] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:38 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1280 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:40.117810 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4a8967e7-43e5-4cb5-89bb-83367a943baa tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:40.117810 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4a8967e7-43e5-4cb5-89bb-83367a943baa tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:40.121460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-de77d50c-392d-41de-83ac-edb55ad13453 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:40.121460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-de77d50c-392d-41de-83ac-edb55ad13453 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:40.122539 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a8967e7-43e5-4cb5-89bb-83367a943baa tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:40.122539 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a8967e7-43e5-4cb5-89bb-83367a943baa tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:40.122539 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a8967e7-43e5-4cb5-89bb-83367a943baa tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:40.122539 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a8967e7-43e5-4cb5-89bb-83367a943baa tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:40.123050 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de77d50c-392d-41de-83ac-edb55ad13453 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:40.124184 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a8967e7-43e5-4cb5-89bb-83367a943baa tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:40.124365 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de77d50c-392d-41de-83ac-edb55ad13453 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:40.124365 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de77d50c-392d-41de-83ac-edb55ad13453 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:40.124689 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a8967e7-43e5-4cb5-89bb-83367a943baa tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:40.125146 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de77d50c-392d-41de-83ac-edb55ad13453 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:40.125146 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de77d50c-392d-41de-83ac-edb55ad13453 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:40.125146 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de77d50c-392d-41de-83ac-edb55ad13453 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:40.260224 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=4 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:40.512213 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-de77d50c-392d-41de-83ac-edb55ad13453 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:40.529390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:40.549270 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-de77d50c-392d-41de-83ac-edb55ad13453 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1280 microversion: 2.1 time: 0.471506 Aug 10 17:14:40.550157 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 14/33] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:40 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1280 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:40.665445 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4a8967e7-43e5-4cb5-89bb-83367a943baa tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:40.679365 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4a8967e7-43e5-4cb5-89bb-83367a943baa tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1272 microversion: 2.1 time: 0.618013 Aug 10 17:14:40.694535 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 20/34] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:40 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1272 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:14:41.595531 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3ec9e536-0d7d-4631-b307-1a1cf733a227 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:41.597550 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3ec9e536-0d7d-4631-b307-1a1cf733a227 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:41.617740 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ec9e536-0d7d-4631-b307-1a1cf733a227 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:41.618557 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ec9e536-0d7d-4631-b307-1a1cf733a227 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:41.620425 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ec9e536-0d7d-4631-b307-1a1cf733a227 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:41.636367 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ec9e536-0d7d-4631-b307-1a1cf733a227 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:41.637090 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ec9e536-0d7d-4631-b307-1a1cf733a227 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:41.640379 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ec9e536-0d7d-4631-b307-1a1cf733a227 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:41.719825 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-652936e3-175a-4bd5-aec9-bab375a31fc4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:41.720704 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-652936e3-175a-4bd5-aec9-bab375a31fc4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:41.740425 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-652936e3-175a-4bd5-aec9-bab375a31fc4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:41.747812 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-652936e3-175a-4bd5-aec9-bab375a31fc4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:41.762485 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-652936e3-175a-4bd5-aec9-bab375a31fc4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:41.766289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-652936e3-175a-4bd5-aec9-bab375a31fc4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:41.770795 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-652936e3-175a-4bd5-aec9-bab375a31fc4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:41.777937 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-652936e3-175a-4bd5-aec9-bab375a31fc4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:43.057158 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-652936e3-175a-4bd5-aec9-bab375a31fc4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:43.071805 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-652936e3-175a-4bd5-aec9-bab375a31fc4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 1.358357 Aug 10 17:14:43.074002 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 21/35] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:41 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:43.096226 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3ec9e536-0d7d-4631-b307-1a1cf733a227 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:43.144092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3ec9e536-0d7d-4631-b307-1a1cf733a227 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 1.550916 Aug 10 17:14:43.147281 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 15/36] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:41 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:44.106039 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ad34e75c-289d-4b23-a74b-d1a4dfc29ae5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:44.107039 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ad34e75c-289d-4b23-a74b-d1a4dfc29ae5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:44.126501 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad34e75c-289d-4b23-a74b-d1a4dfc29ae5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:44.135666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad34e75c-289d-4b23-a74b-d1a4dfc29ae5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:44.135666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad34e75c-289d-4b23-a74b-d1a4dfc29ae5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:44.135666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad34e75c-289d-4b23-a74b-d1a4dfc29ae5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:44.136369 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad34e75c-289d-4b23-a74b-d1a4dfc29ae5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:44.136800 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad34e75c-289d-4b23-a74b-d1a4dfc29ae5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:44.191678 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e945cd77-543e-472b-9a0e-039019a18850 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:44.195139 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e945cd77-543e-472b-9a0e-039019a18850 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:44.232267 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=22 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:44.239167 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e945cd77-543e-472b-9a0e-039019a18850 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:44.245307 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e945cd77-543e-472b-9a0e-039019a18850 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:44.245945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e945cd77-543e-472b-9a0e-039019a18850 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:44.247318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e945cd77-543e-472b-9a0e-039019a18850 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:44.252911 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e945cd77-543e-472b-9a0e-039019a18850 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:44.253657 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e945cd77-543e-472b-9a0e-039019a18850 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:44.586257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=18 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:45.625130 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e945cd77-543e-472b-9a0e-039019a18850 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:45.655623 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e945cd77-543e-472b-9a0e-039019a18850 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 1.473448 Aug 10 17:14:45.679817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 16/37] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:44 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:45.753012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ad34e75c-289d-4b23-a74b-d1a4dfc29ae5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:45.816921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ad34e75c-289d-4b23-a74b-d1a4dfc29ae5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 1.724623 Aug 10 17:14:45.823071 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 22/38] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:44 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:46.702926 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fcf6a1bc-4bed-4c42-9cbe-95b28a36b229 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:46.710599 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fcf6a1bc-4bed-4c42-9cbe-95b28a36b229 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:46.750882 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcf6a1bc-4bed-4c42-9cbe-95b28a36b229 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:46.766107 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcf6a1bc-4bed-4c42-9cbe-95b28a36b229 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:46.766107 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcf6a1bc-4bed-4c42-9cbe-95b28a36b229 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:46.766107 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcf6a1bc-4bed-4c42-9cbe-95b28a36b229 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:46.766792 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcf6a1bc-4bed-4c42-9cbe-95b28a36b229 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:46.767600 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcf6a1bc-4bed-4c42-9cbe-95b28a36b229 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:46.851811 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ff1cdc15-8f5c-4b32-98e2-00c66fb62528 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:46.852942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ff1cdc15-8f5c-4b32-98e2-00c66fb62528 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:46.910100 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff1cdc15-8f5c-4b32-98e2-00c66fb62528 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:46.914965 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff1cdc15-8f5c-4b32-98e2-00c66fb62528 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:46.922503 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff1cdc15-8f5c-4b32-98e2-00c66fb62528 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:46.927365 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff1cdc15-8f5c-4b32-98e2-00c66fb62528 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:46.930148 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff1cdc15-8f5c-4b32-98e2-00c66fb62528 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:46.932894 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff1cdc15-8f5c-4b32-98e2-00c66fb62528 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:49.162439 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ff1cdc15-8f5c-4b32-98e2-00c66fb62528 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:49.183789 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ff1cdc15-8f5c-4b32-98e2-00c66fb62528 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 2.338943 Aug 10 17:14:49.188183 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 23/39] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:46 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 2342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:14:49.215861 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fcf6a1bc-4bed-4c42-9cbe-95b28a36b229 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:49.233476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fcf6a1bc-4bed-4c42-9cbe-95b28a36b229 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 2.540296 Aug 10 17:14:49.234318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 17/40] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:46 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 2542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:49.554601 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-6ffbc22c-d50c-4a4e-84cd-f3c7a635490e req-5dde15a9-b573-432f-a3c0-44c769c0a9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb", "tag": "f385660a-21a4-436a-92ac-359d6c02f514"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:49.555643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-a6dfe4db-7e7d-4e8e-8154-90f8013e95ea req-db5dbcf8-f830-4d54-8115-692fd4299577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d5e24ad-a791-4465-be5f-0b99c26f2655", "tag": "e9bdd79f-d6e0-4ff0-a545-38e482ce16a2"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:49.615377 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-6ffbc22c-d50c-4a4e-84cd-f3c7a635490e req-5dde15a9-b573-432f-a3c0-44c769c0a9a9 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:49.616142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-6ffbc22c-d50c-4a4e-84cd-f3c7a635490e req-5dde15a9-b573-432f-a3c0-44c769c0a9a9 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:49.617481 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-6ffbc22c-d50c-4a4e-84cd-f3c7a635490e req-5dde15a9-b573-432f-a3c0-44c769c0a9a9 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:49.625021 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a6dfe4db-7e7d-4e8e-8154-90f8013e95ea req-db5dbcf8-f830-4d54-8115-692fd4299577 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:49.629636 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a6dfe4db-7e7d-4e8e-8154-90f8013e95ea req-db5dbcf8-f830-4d54-8115-692fd4299577 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:49.629636 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a6dfe4db-7e7d-4e8e-8154-90f8013e95ea req-db5dbcf8-f830-4d54-8115-692fd4299577 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:49.644079 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-6ffbc22c-d50c-4a4e-84cd-f3c7a635490e req-5dde15a9-b573-432f-a3c0-44c769c0a9a9 service nova] Creating event network-changed:f385660a-21a4-436a-92ac-359d6c02f514 for instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb on hv-cinder-85272 Aug 10 17:14:49.644879 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-6ffbc22c-d50c-4a4e-84cd-f3c7a635490e req-5dde15a9-b573-432f-a3c0-44c769c0a9a9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121232) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 17:14:49.645444 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-6ffbc22c-d50c-4a4e-84cd-f3c7a635490e req-5dde15a9-b573-432f-a3c0-44c769c0a9a9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121232) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 17:14:49.647722 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d617a2ae-320a-4c03-9897-fac7f8000f70 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:49.648346 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d617a2ae-320a-4c03-9897-fac7f8000f70 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:49.649007 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d617a2ae-320a-4c03-9897-fac7f8000f70 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:49.650702 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d617a2ae-320a-4c03-9897-fac7f8000f70 None None] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:49.651349 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d617a2ae-320a-4c03-9897-fac7f8000f70 None None] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:49.652079 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d617a2ae-320a-4c03-9897-fac7f8000f70 None None] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:49.664533 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.compute.rpcapi [None req-d617a2ae-320a-4c03-9897-fac7f8000f70 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 17:14:49.665968 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d617a2ae-320a-4c03-9897-fac7f8000f70 None None] Releasing lock "compute-rpcapi-router" {{(pid=121232) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 17:14:49.679131 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-a6dfe4db-7e7d-4e8e-8154-90f8013e95ea req-db5dbcf8-f830-4d54-8115-692fd4299577 service nova] Creating event network-changed:e9bdd79f-d6e0-4ff0-a545-38e482ce16a2 for instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 on hv-cinder-85272 Aug 10 17:14:49.680540 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a6dfe4db-7e7d-4e8e-8154-90f8013e95ea req-db5dbcf8-f830-4d54-8115-692fd4299577 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121231) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 17:14:49.681517 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a6dfe4db-7e7d-4e8e-8154-90f8013e95ea req-db5dbcf8-f830-4d54-8115-692fd4299577 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121231) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 17:14:49.684660 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e892ee34-8bdf-40b6-a6cc-ee8eb65fa72b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:49.685874 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e892ee34-8bdf-40b6-a6cc-ee8eb65fa72b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:49.687046 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e892ee34-8bdf-40b6-a6cc-ee8eb65fa72b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:49.689112 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e892ee34-8bdf-40b6-a6cc-ee8eb65fa72b None None] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:49.690279 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e892ee34-8bdf-40b6-a6cc-ee8eb65fa72b None None] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:49.694489 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e892ee34-8bdf-40b6-a6cc-ee8eb65fa72b None None] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:49.708630 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d617a2ae-320a-4c03-9897-fac7f8000f70 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.459802 Aug 10 17:14:49.709715 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.compute.rpcapi [None req-e892ee34-8bdf-40b6-a6cc-ee8eb65fa72b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 17:14:49.710151 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 18/41] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:14:49.712055 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e892ee34-8bdf-40b6-a6cc-ee8eb65fa72b None None] Releasing lock "compute-rpcapi-router" {{(pid=121231) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 17:14:49.741691 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e892ee34-8bdf-40b6-a6cc-ee8eb65fa72b None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.553738 Aug 10 17:14:49.752163 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 24/42] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:14:49.802661 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2097491385", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df762851-303d-4aa3-ad7c-336bef1a7d98"}], "security_groups": [{"name": "tempest-securitygroup--2039166747"}], "key_name": "tempest-keypair-1503583688", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:50.028021 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] validate_networks() for [('df762851-303d-4aa3-ad7c-336bef1a7d98', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:14:50.105331 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2125149673", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa424745-59e7-4688-a728-8cee87fc07ca"}], "security_groups": [{"name": "tempest-securitygroup--736411354"}], "key_name": "tempest-keypair-1792548518", "user_data": "}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:50.375621 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] validate_networks() for [('aa424745-59e7-4688-a728-8cee87fc07ca', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:14:51.401952 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:14:51.401952 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:14:51.401952 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:14:51.401952 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:14:51.402748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:14:51.424741 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=8 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:51.471051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:51.480889 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:51.480889 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:51.480889 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:51.480889 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:51.481490 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:51.526011 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=51 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:51.610262 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:14:51.627487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for user 48feb2fc02f04e739c5e1bf7d68baa16 and project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:14:51.680246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:14:51.701606 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:14:51.961981 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4102d794-6299-428a-9d2a-7f67c86b13de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.167973 Aug 10 17:14:51.964727 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 19/43] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:14:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 2173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:14:51.976119 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-af6e93d0-a0dd-49a1-8c9e-ecdf4a7439c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:51.977781 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-af6e93d0-a0dd-49a1-8c9e-ecdf4a7439c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:51.993549 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-af6e93d0-a0dd-49a1-8c9e-ecdf4a7439c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:51.996910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-af6e93d0-a0dd-49a1-8c9e-ecdf4a7439c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:51.998269 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-af6e93d0-a0dd-49a1-8c9e-ecdf4a7439c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:52.001227 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-af6e93d0-a0dd-49a1-8c9e-ecdf4a7439c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:52.002702 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-af6e93d0-a0dd-49a1-8c9e-ecdf4a7439c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:52.004342 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-af6e93d0-a0dd-49a1-8c9e-ecdf4a7439c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:52.386285 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:14:52.387155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:14:52.387318 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:14:52.388621 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:14:52.389048 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:14:52.422758 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:52.426554 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:52.427379 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:52.428829 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:52.433927 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:52.439433 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:52.509042 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Getting quotas for project 7e92e1e1c27241798e336e547580be5e. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:14:52.515097 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Getting quotas for user 2f74a20789dc4ef697861146252bacba and project 7e92e1e1c27241798e336e547580be5e. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:14:52.530997 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:14:52.534616 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:14:52.710384 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-af6e93d0-a0dd-49a1-8c9e-ecdf4a7439c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:52.736707 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-af6e93d0-a0dd-49a1-8c9e-ecdf4a7439c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.769049 Aug 10 17:14:52.745587 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 20/44] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:51 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:52.759176 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-617be39a-d032-48a2-91ba-30403f5d1a56 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:52.760709 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-617be39a-d032-48a2-91ba-30403f5d1a56 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:52.828906 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-617be39a-d032-48a2-91ba-30403f5d1a56 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:52.829737 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-617be39a-d032-48a2-91ba-30403f5d1a56 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:52.830571 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-617be39a-d032-48a2-91ba-30403f5d1a56 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:52.855792 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-617be39a-d032-48a2-91ba-30403f5d1a56 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:52.859326 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-617be39a-d032-48a2-91ba-30403f5d1a56 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:52.860585 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-617be39a-d032-48a2-91ba-30403f5d1a56 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:52.921766 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-410d0ca7-3fa9-4d25-848b-f4c79e8b6f01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.801918 Aug 10 17:14:52.928419 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 25/45] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:14:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 2834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:14:52.949506 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-799566572", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c304dfa-d435-4428-99f4-91e05a894449"}], "security_groups": [{"name": "tempest-securitygroup--34625948"}], "key_name": "tempest-keypair-1314704727", "user_data": "}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:54.006627 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] validate_networks() for [('3c304dfa-d435-4428-99f4-91e05a894449', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:14:54.305314 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-617be39a-d032-48a2-91ba-30403f5d1a56 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:54.347683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-617be39a-d032-48a2-91ba-30403f5d1a56 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 1.599669 Aug 10 17:14:54.353681 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 21/46] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:52 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:54.366868 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c26258be-4f28-4479-b4a1-74097d1bd922 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:54.376085 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c26258be-4f28-4479-b4a1-74097d1bd922 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:54.556131 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c26258be-4f28-4479-b4a1-74097d1bd922 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:54.561767 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c26258be-4f28-4479-b4a1-74097d1bd922 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1242 microversion: 2.1 time: 0.205756 Aug 10 17:14:54.562109 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 22/47] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:54 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1242 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:54.579835 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-0d798cf0-8f90-4924-83a5-23210c38a7b7 req-e8e3f508-24e7-49e1-9937-5e06eac9ac5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af2fcf04-eb83-455a-bb58-b8c23b16f58d", "tag": "b302d1cc-652d-4c9c-add6-c1dc1428f8c5"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:14:54.597124 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0d798cf0-8f90-4924-83a5-23210c38a7b7 req-e8e3f508-24e7-49e1-9937-5e06eac9ac5a service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:54.597124 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0d798cf0-8f90-4924-83a5-23210c38a7b7 req-e8e3f508-24e7-49e1-9937-5e06eac9ac5a service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:54.597124 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0d798cf0-8f90-4924-83a5-23210c38a7b7 req-e8e3f508-24e7-49e1-9937-5e06eac9ac5a service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:54.641640 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-0d798cf0-8f90-4924-83a5-23210c38a7b7 req-e8e3f508-24e7-49e1-9937-5e06eac9ac5a service nova] Creating event network-changed:b302d1cc-652d-4c9c-add6-c1dc1428f8c5 for instance af2fcf04-eb83-455a-bb58-b8c23b16f58d on hv-cinder-85272 Aug 10 17:14:54.674937 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-0d798cf0-8f90-4924-83a5-23210c38a7b7 req-e8e3f508-24e7-49e1-9937-5e06eac9ac5a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080478 Aug 10 17:14:54.675885 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 23/48] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:14:54.683148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fee681c5-104a-46b5-8cb9-19d36db2791a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:54.688513 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fee681c5-104a-46b5-8cb9-19d36db2791a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:54.830607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fee681c5-104a-46b5-8cb9-19d36db2791a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:54.848293 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fee681c5-104a-46b5-8cb9-19d36db2791a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1238 microversion: 2.1 time: 0.168982 Aug 10 17:14:54.854784 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 24/49] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:54 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1238 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:54.899117 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2cd8d735-a245-4046-ad20-b181e9cca491 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:54.905206 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2cd8d735-a245-4046-ad20-b181e9cca491 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:54.933192 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2cd8d735-a245-4046-ad20-b181e9cca491 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:54.944596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2cd8d735-a245-4046-ad20-b181e9cca491 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:54.945967 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2cd8d735-a245-4046-ad20-b181e9cca491 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:54.950459 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2cd8d735-a245-4046-ad20-b181e9cca491 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:54.952932 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2cd8d735-a245-4046-ad20-b181e9cca491 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:54.956926 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2cd8d735-a245-4046-ad20-b181e9cca491 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:55.784890 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2cd8d735-a245-4046-ad20-b181e9cca491 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:55.821619 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2cd8d735-a245-4046-ad20-b181e9cca491 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.963204 Aug 10 17:14:55.838899 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 25/50] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:54 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:55.848842 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a2081adf-30a1-44fd-b745-7b2337a58a8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:55.850194 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a2081adf-30a1-44fd-b745-7b2337a58a8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:55.859312 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2081adf-30a1-44fd-b745-7b2337a58a8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:55.860202 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2081adf-30a1-44fd-b745-7b2337a58a8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:55.860952 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2081adf-30a1-44fd-b745-7b2337a58a8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:55.862102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2081adf-30a1-44fd-b745-7b2337a58a8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:55.862910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2081adf-30a1-44fd-b745-7b2337a58a8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:55.863761 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2081adf-30a1-44fd-b745-7b2337a58a8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:56.255617 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:14:56.256479 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:14:56.257275 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:14:56.258025 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:14:56.267001 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:14:56.312988 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:56.375674 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:56.376528 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:56.377319 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:56.414451 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:56.421750 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:56.428720 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:56.461710 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a2081adf-30a1-44fd-b745-7b2337a58a8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:56.475050 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a2081adf-30a1-44fd-b745-7b2337a58a8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.633842 Aug 10 17:14:56.479297 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 26/51] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:55 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:56.487746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-75897b13-59aa-4a11-985a-383f7e7ec6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:56.491428 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-75897b13-59aa-4a11-985a-383f7e7ec6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:56.495782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=51 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:56.519811 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75897b13-59aa-4a11-985a-383f7e7ec6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:56.521462 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75897b13-59aa-4a11-985a-383f7e7ec6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:56.525625 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75897b13-59aa-4a11-985a-383f7e7ec6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:56.527350 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75897b13-59aa-4a11-985a-383f7e7ec6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:56.534548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75897b13-59aa-4a11-985a-383f7e7ec6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:56.535532 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75897b13-59aa-4a11-985a-383f7e7ec6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:56.619700 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Getting quotas for project ed45fd312c58480f993616d451abcab7. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:14:56.663465 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Getting quotas for user 5bf9229cd5d6429ea14249f8976e83cc and project ed45fd312c58480f993616d451abcab7. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:14:56.677815 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:14:56.683843 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:14:56.867173 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-75897b13-59aa-4a11-985a-383f7e7ec6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:56.877235 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-75897b13-59aa-4a11-985a-383f7e7ec6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1246 microversion: 2.1 time: 0.396225 Aug 10 17:14:56.878255 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 27/52] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:56 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1246 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:56.884325 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-60e4835c-3c6a-4ff6-b38e-ee18d1bda337 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:56.885432 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-60e4835c-3c6a-4ff6-b38e-ee18d1bda337 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:56.895954 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60e4835c-3c6a-4ff6-b38e-ee18d1bda337 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:56.900973 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60e4835c-3c6a-4ff6-b38e-ee18d1bda337 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:56.900973 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60e4835c-3c6a-4ff6-b38e-ee18d1bda337 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:56.900973 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60e4835c-3c6a-4ff6-b38e-ee18d1bda337 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:56.900973 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60e4835c-3c6a-4ff6-b38e-ee18d1bda337 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:56.901660 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60e4835c-3c6a-4ff6-b38e-ee18d1bda337 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:56.965849 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c496d9ea-31e4-4135-8a90-093b46ed56ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 4.034611 Aug 10 17:14:56.974241 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 26/53] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Aug 10 17:14:52 2022] POST /compute/v2.1/servers => generated 400 bytes in 4044 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 17:14:56.984473 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3270b817-fd82-444a-9c23-14090e6d757b tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:56.987091 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3270b817-fd82-444a-9c23-14090e6d757b tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:56.996414 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3270b817-fd82-444a-9c23-14090e6d757b tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:56.996994 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3270b817-fd82-444a-9c23-14090e6d757b tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:56.997434 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3270b817-fd82-444a-9c23-14090e6d757b tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:56.998374 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3270b817-fd82-444a-9c23-14090e6d757b tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:56.999462 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3270b817-fd82-444a-9c23-14090e6d757b tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:57.002510 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3270b817-fd82-444a-9c23-14090e6d757b tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:57.071423 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-60e4835c-3c6a-4ff6-b38e-ee18d1bda337 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:57.088700 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-60e4835c-3c6a-4ff6-b38e-ee18d1bda337 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1242 microversion: 2.1 time: 0.207800 Aug 10 17:14:57.108869 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 28/54] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:56 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1242 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:57.120795 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ee5c3190-7833-4591-b6d0-6c7b918c4f32 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:57.123078 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ee5c3190-7833-4591-b6d0-6c7b918c4f32 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:57.294700 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ee5c3190-7833-4591-b6d0-6c7b918c4f32 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:57.308903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ee5c3190-7833-4591-b6d0-6c7b918c4f32 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:57.324437 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ee5c3190-7833-4591-b6d0-6c7b918c4f32 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:57.325633 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ee5c3190-7833-4591-b6d0-6c7b918c4f32 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1281 microversion: 2.20 time: 0.214521 Aug 10 17:14:57.326412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 29/55] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:14:57 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1281 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:14:57.356505 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3270b817-fd82-444a-9c23-14090e6d757b tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:57.367830 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3270b817-fd82-444a-9c23-14090e6d757b tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.391279 Aug 10 17:14:57.368490 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 27/56] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:56 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:57.518409 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-85fc146e-890f-46b3-8a2e-6d1d2aa19be5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:57.519279 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-85fc146e-890f-46b3-8a2e-6d1d2aa19be5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:57.528525 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-85fc146e-890f-46b3-8a2e-6d1d2aa19be5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:57.529009 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-85fc146e-890f-46b3-8a2e-6d1d2aa19be5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:57.529819 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-85fc146e-890f-46b3-8a2e-6d1d2aa19be5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:57.530253 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-85fc146e-890f-46b3-8a2e-6d1d2aa19be5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:57.530809 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-85fc146e-890f-46b3-8a2e-6d1d2aa19be5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:57.531601 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-85fc146e-890f-46b3-8a2e-6d1d2aa19be5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:57.699989 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-85fc146e-890f-46b3-8a2e-6d1d2aa19be5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:57.712256 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-85fc146e-890f-46b3-8a2e-6d1d2aa19be5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.199434 Aug 10 17:14:57.713332 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 30/57] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:57 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:14:57.908866 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-81f951c6-3e0a-4a0e-b6c9-4bb1a230bc94 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:57.909487 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-81f951c6-3e0a-4a0e-b6c9-4bb1a230bc94 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:57.916471 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81f951c6-3e0a-4a0e-b6c9-4bb1a230bc94 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:57.916963 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81f951c6-3e0a-4a0e-b6c9-4bb1a230bc94 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:57.917400 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81f951c6-3e0a-4a0e-b6c9-4bb1a230bc94 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:57.918105 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81f951c6-3e0a-4a0e-b6c9-4bb1a230bc94 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:57.918595 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81f951c6-3e0a-4a0e-b6c9-4bb1a230bc94 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:57.919069 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81f951c6-3e0a-4a0e-b6c9-4bb1a230bc94 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:57.982696 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-81f951c6-3e0a-4a0e-b6c9-4bb1a230bc94 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:57.990378 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-81f951c6-3e0a-4a0e-b6c9-4bb1a230bc94 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1294 microversion: 2.1 time: 0.085974 Aug 10 17:14:57.993466 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 28/58] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:57 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:58.114184 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-27849734-dd24-410e-bff2-2dc4051302fa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:58.116185 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-27849734-dd24-410e-bff2-2dc4051302fa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:58.121261 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27849734-dd24-410e-bff2-2dc4051302fa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:58.121746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27849734-dd24-410e-bff2-2dc4051302fa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:58.122177 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27849734-dd24-410e-bff2-2dc4051302fa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:58.122919 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27849734-dd24-410e-bff2-2dc4051302fa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:58.123372 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27849734-dd24-410e-bff2-2dc4051302fa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:58.123792 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27849734-dd24-410e-bff2-2dc4051302fa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:58.192909 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-27849734-dd24-410e-bff2-2dc4051302fa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:58.208349 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-27849734-dd24-410e-bff2-2dc4051302fa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1290 microversion: 2.1 time: 0.091395 Aug 10 17:14:58.208349 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 31/59] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:58 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:58.364498 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0f206244-0bbf-46ec-88ec-e3e19e74ebb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:58.365192 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0f206244-0bbf-46ec-88ec-e3e19e74ebb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:58.372861 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f206244-0bbf-46ec-88ec-e3e19e74ebb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:58.373437 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f206244-0bbf-46ec-88ec-e3e19e74ebb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:58.374010 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f206244-0bbf-46ec-88ec-e3e19e74ebb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:58.374883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f206244-0bbf-46ec-88ec-e3e19e74ebb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:58.375433 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f206244-0bbf-46ec-88ec-e3e19e74ebb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:58.375943 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f206244-0bbf-46ec-88ec-e3e19e74ebb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:58.406193 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-20afa2e2-f243-4cfa-9603-baff7f790049 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:58.407763 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-20afa2e2-f243-4cfa-9603-baff7f790049 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:58.418022 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20afa2e2-f243-4cfa-9603-baff7f790049 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:58.418946 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20afa2e2-f243-4cfa-9603-baff7f790049 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:58.419739 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20afa2e2-f243-4cfa-9603-baff7f790049 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:58.421003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20afa2e2-f243-4cfa-9603-baff7f790049 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:58.421801 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20afa2e2-f243-4cfa-9603-baff7f790049 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:58.422624 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20afa2e2-f243-4cfa-9603-baff7f790049 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:58.457145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0f206244-0bbf-46ec-88ec-e3e19e74ebb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:58.474386 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0f206244-0bbf-46ec-88ec-e3e19e74ebb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:58.476358 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0f206244-0bbf-46ec-88ec-e3e19e74ebb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:58.477655 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0f206244-0bbf-46ec-88ec-e3e19e74ebb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1285 microversion: 2.20 time: 0.117100 Aug 10 17:14:58.490843 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 29/60] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:14:58 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:14:58.747356 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-beebb278-cb2b-42d8-8f05-0b1f53d9e9ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:58.748073 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-beebb278-cb2b-42d8-8f05-0b1f53d9e9ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:58.755469 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-beebb278-cb2b-42d8-8f05-0b1f53d9e9ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:58.756063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-beebb278-cb2b-42d8-8f05-0b1f53d9e9ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:58.756558 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-beebb278-cb2b-42d8-8f05-0b1f53d9e9ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:58.757321 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-beebb278-cb2b-42d8-8f05-0b1f53d9e9ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:58.757927 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-beebb278-cb2b-42d8-8f05-0b1f53d9e9ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:58.758549 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-beebb278-cb2b-42d8-8f05-0b1f53d9e9ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:58.998439 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-20afa2e2-f243-4cfa-9603-baff7f790049 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:59.011800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-20afa2e2-f243-4cfa-9603-baff7f790049 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.612331 Aug 10 17:14:59.013199 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 32/61] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:58 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:14:59.022807 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-849dd25b-352b-43e5-8f2d-995b57dee69f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:59.024496 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-849dd25b-352b-43e5-8f2d-995b57dee69f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:59.039889 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-849dd25b-352b-43e5-8f2d-995b57dee69f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:59.041672 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-849dd25b-352b-43e5-8f2d-995b57dee69f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:59.042773 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-849dd25b-352b-43e5-8f2d-995b57dee69f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:59.044493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-849dd25b-352b-43e5-8f2d-995b57dee69f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:59.045549 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-849dd25b-352b-43e5-8f2d-995b57dee69f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:59.046587 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-849dd25b-352b-43e5-8f2d-995b57dee69f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:59.049423 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-beebb278-cb2b-42d8-8f05-0b1f53d9e9ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:59.059240 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-beebb278-cb2b-42d8-8f05-0b1f53d9e9ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.317096 Aug 10 17:14:59.066933 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 30/62] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:58 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:14:59.137124 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-849dd25b-352b-43e5-8f2d-995b57dee69f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:59.145138 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-849dd25b-352b-43e5-8f2d-995b57dee69f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1294 microversion: 2.1 time: 0.130335 Aug 10 17:14:59.145976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 33/63] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:59 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1294 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:59.224521 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5bfe5fbc-1558-4588-b743-352a4f826d77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:59.225358 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5bfe5fbc-1558-4588-b743-352a4f826d77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:59.233122 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5bfe5fbc-1558-4588-b743-352a4f826d77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:59.233746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5bfe5fbc-1558-4588-b743-352a4f826d77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:59.234251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5bfe5fbc-1558-4588-b743-352a4f826d77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:59.235081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5bfe5fbc-1558-4588-b743-352a4f826d77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:59.235805 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5bfe5fbc-1558-4588-b743-352a4f826d77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:59.236367 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5bfe5fbc-1558-4588-b743-352a4f826d77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:59.304605 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5bfe5fbc-1558-4588-b743-352a4f826d77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:59.313971 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5bfe5fbc-1558-4588-b743-352a4f826d77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1290 microversion: 2.1 time: 0.093425 Aug 10 17:14:59.314765 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 31/64] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:14:59 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:14:59.504839 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-50cf60a7-a2b4-4cb3-8bd2-b2f2c8bf47c9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:14:59.505885 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-50cf60a7-a2b4-4cb3-8bd2-b2f2c8bf47c9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:14:59.516547 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50cf60a7-a2b4-4cb3-8bd2-b2f2c8bf47c9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:59.518864 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50cf60a7-a2b4-4cb3-8bd2-b2f2c8bf47c9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:59.518864 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50cf60a7-a2b4-4cb3-8bd2-b2f2c8bf47c9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:59.518864 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50cf60a7-a2b4-4cb3-8bd2-b2f2c8bf47c9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:14:59.519562 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50cf60a7-a2b4-4cb3-8bd2-b2f2c8bf47c9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:14:59.520369 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50cf60a7-a2b4-4cb3-8bd2-b2f2c8bf47c9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:14:59.629385 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-50cf60a7-a2b4-4cb3-8bd2-b2f2c8bf47c9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:59.646723 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-50cf60a7-a2b4-4cb3-8bd2-b2f2c8bf47c9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:59.649099 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-50cf60a7-a2b4-4cb3-8bd2-b2f2c8bf47c9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:14:59.650677 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-50cf60a7-a2b4-4cb3-8bd2-b2f2c8bf47c9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1285 microversion: 2.20 time: 0.152715 Aug 10 17:14:59.651501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 34/65] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:14:59 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:00.051824 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b71be430-9444-4094-a930-96565a1b8663 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:00.052719 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b71be430-9444-4094-a930-96565a1b8663 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:00.060019 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b71be430-9444-4094-a930-96565a1b8663 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:00.060699 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b71be430-9444-4094-a930-96565a1b8663 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:00.061147 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b71be430-9444-4094-a930-96565a1b8663 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:00.061950 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b71be430-9444-4094-a930-96565a1b8663 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:00.062458 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b71be430-9444-4094-a930-96565a1b8663 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:00.062876 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b71be430-9444-4094-a930-96565a1b8663 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:00.083020 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a3710dc9-f16c-44e7-a49c-027a6b2bfff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:00.084704 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a3710dc9-f16c-44e7-a49c-027a6b2bfff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:00.095864 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3710dc9-f16c-44e7-a49c-027a6b2bfff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:00.096693 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3710dc9-f16c-44e7-a49c-027a6b2bfff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:00.097311 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3710dc9-f16c-44e7-a49c-027a6b2bfff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:00.098243 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3710dc9-f16c-44e7-a49c-027a6b2bfff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:00.099061 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3710dc9-f16c-44e7-a49c-027a6b2bfff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:00.099672 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3710dc9-f16c-44e7-a49c-027a6b2bfff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:00.490973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b71be430-9444-4094-a930-96565a1b8663 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:00.499691 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b71be430-9444-4094-a930-96565a1b8663 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.452691 Aug 10 17:15:00.500956 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 32/66] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:00 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:00.505635 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ed97e46b-2e21-442d-9030-01ff7ffea3b0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:00.506647 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ed97e46b-2e21-442d-9030-01ff7ffea3b0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:00.517609 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ed97e46b-2e21-442d-9030-01ff7ffea3b0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:00.518971 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ed97e46b-2e21-442d-9030-01ff7ffea3b0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:00.520010 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ed97e46b-2e21-442d-9030-01ff7ffea3b0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:00.521555 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ed97e46b-2e21-442d-9030-01ff7ffea3b0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:00.523454 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ed97e46b-2e21-442d-9030-01ff7ffea3b0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:00.524399 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ed97e46b-2e21-442d-9030-01ff7ffea3b0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:00.539754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a3710dc9-f16c-44e7-a49c-027a6b2bfff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:00.558410 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a3710dc9-f16c-44e7-a49c-027a6b2bfff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.480635 Aug 10 17:15:00.558827 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 35/67] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:00 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:00.576157 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-59cc979c-d11b-4c44-992e-60f4414ad14b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:00.576787 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-59cc979c-d11b-4c44-992e-60f4414ad14b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:00.585583 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-59cc979c-d11b-4c44-992e-60f4414ad14b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:00.586088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-59cc979c-d11b-4c44-992e-60f4414ad14b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:00.586579 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-59cc979c-d11b-4c44-992e-60f4414ad14b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:00.588734 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-59cc979c-d11b-4c44-992e-60f4414ad14b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:00.589596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-59cc979c-d11b-4c44-992e-60f4414ad14b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:00.590494 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-59cc979c-d11b-4c44-992e-60f4414ad14b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:00.674967 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ed97e46b-2e21-442d-9030-01ff7ffea3b0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:00.684415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ed97e46b-2e21-442d-9030-01ff7ffea3b0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1294 microversion: 2.1 time: 0.182174 Aug 10 17:15:00.685215 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 33/68] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:00 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1294 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:00.690481 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-545df33f-6979-4880-a6be-be2b0ae4f736 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:00.691100 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-545df33f-6979-4880-a6be-be2b0ae4f736 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:00.711709 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-545df33f-6979-4880-a6be-be2b0ae4f736 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:00.712518 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-545df33f-6979-4880-a6be-be2b0ae4f736 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:00.713799 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-545df33f-6979-4880-a6be-be2b0ae4f736 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:00.714759 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-545df33f-6979-4880-a6be-be2b0ae4f736 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:00.715678 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-545df33f-6979-4880-a6be-be2b0ae4f736 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:00.716278 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-545df33f-6979-4880-a6be-be2b0ae4f736 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:00.756309 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-59cc979c-d11b-4c44-992e-60f4414ad14b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:00.765312 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-59cc979c-d11b-4c44-992e-60f4414ad14b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1290 microversion: 2.1 time: 0.205387 Aug 10 17:15:00.765903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 36/69] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:00 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1290 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:00.797219 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-545df33f-6979-4880-a6be-be2b0ae4f736 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:00.808101 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-545df33f-6979-4880-a6be-be2b0ae4f736 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:00.810704 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-545df33f-6979-4880-a6be-be2b0ae4f736 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:00.812013 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-545df33f-6979-4880-a6be-be2b0ae4f736 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1285 microversion: 2.20 time: 0.125594 Aug 10 17:15:00.812660 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 34/70] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:00 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:01.537421 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-69a92460-3713-4fa0-a5bf-734b9b38a942 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:01.540437 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-69a92460-3713-4fa0-a5bf-734b9b38a942 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:01.540437 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=4 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:01.545817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69a92460-3713-4fa0-a5bf-734b9b38a942 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:01.546315 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69a92460-3713-4fa0-a5bf-734b9b38a942 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:01.546783 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69a92460-3713-4fa0-a5bf-734b9b38a942 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:01.547506 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69a92460-3713-4fa0-a5bf-734b9b38a942 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:01.547956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69a92460-3713-4fa0-a5bf-734b9b38a942 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:01.548432 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69a92460-3713-4fa0-a5bf-734b9b38a942 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:01.595365 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-aa113db8-ec43-4ab3-a941-533211164c33 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:01.596421 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-aa113db8-ec43-4ab3-a941-533211164c33 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:01.607894 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aa113db8-ec43-4ab3-a941-533211164c33 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:01.608710 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aa113db8-ec43-4ab3-a941-533211164c33 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:01.614555 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aa113db8-ec43-4ab3-a941-533211164c33 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:01.614555 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aa113db8-ec43-4ab3-a941-533211164c33 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:01.614555 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aa113db8-ec43-4ab3-a941-533211164c33 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:01.614555 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aa113db8-ec43-4ab3-a941-533211164c33 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:01.840135 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-69a92460-3713-4fa0-a5bf-734b9b38a942 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:01.855224 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-69a92460-3713-4fa0-a5bf-734b9b38a942 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.321727 Aug 10 17:15:01.857031 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 37/71] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:01 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:01.865997 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f6ffe190-b3a9-46ec-88cd-977d5b80def9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:01.867358 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f6ffe190-b3a9-46ec-88cd-977d5b80def9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:01.878996 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6ffe190-b3a9-46ec-88cd-977d5b80def9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:01.880582 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6ffe190-b3a9-46ec-88cd-977d5b80def9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:01.881620 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6ffe190-b3a9-46ec-88cd-977d5b80def9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:01.881940 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-aa113db8-ec43-4ab3-a941-533211164c33 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:01.882853 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6ffe190-b3a9-46ec-88cd-977d5b80def9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:01.883346 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6ffe190-b3a9-46ec-88cd-977d5b80def9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:01.884055 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6ffe190-b3a9-46ec-88cd-977d5b80def9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:01.892610 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-aa113db8-ec43-4ab3-a941-533211164c33 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.300415 Aug 10 17:15:01.892610 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 35/72] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:01 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:01.897345 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f3a46e49-8ef7-4060-9d17-54677598a522 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:01.898102 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f3a46e49-8ef7-4060-9d17-54677598a522 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:01.904840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3a46e49-8ef7-4060-9d17-54677598a522 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:01.905325 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3a46e49-8ef7-4060-9d17-54677598a522 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:01.905759 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3a46e49-8ef7-4060-9d17-54677598a522 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:01.906499 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3a46e49-8ef7-4060-9d17-54677598a522 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:01.907038 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3a46e49-8ef7-4060-9d17-54677598a522 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:01.907636 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3a46e49-8ef7-4060-9d17-54677598a522 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:01.997703 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f6ffe190-b3a9-46ec-88cd-977d5b80def9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:02.001608 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f3a46e49-8ef7-4060-9d17-54677598a522 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:02.005996 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f6ffe190-b3a9-46ec-88cd-977d5b80def9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1294 microversion: 2.1 time: 0.147135 Aug 10 17:15:02.006787 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 38/73] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:01 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1294 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:02.014248 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0572d292-d83e-48dc-88c9-e82d002f5012 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:02.015021 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0572d292-d83e-48dc-88c9-e82d002f5012 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:02.017704 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f3a46e49-8ef7-4060-9d17-54677598a522 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1298 microversion: 2.1 time: 0.123462 Aug 10 17:15:02.018820 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 36/74] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:01 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1298 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:02.031065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0572d292-d83e-48dc-88c9-e82d002f5012 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:02.031817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0572d292-d83e-48dc-88c9-e82d002f5012 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:02.033487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0572d292-d83e-48dc-88c9-e82d002f5012 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:02.034288 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0572d292-d83e-48dc-88c9-e82d002f5012 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:02.034883 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0572d292-d83e-48dc-88c9-e82d002f5012 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:02.035409 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0572d292-d83e-48dc-88c9-e82d002f5012 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:02.112351 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0572d292-d83e-48dc-88c9-e82d002f5012 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:02.118297 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0572d292-d83e-48dc-88c9-e82d002f5012 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:02.120443 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0572d292-d83e-48dc-88c9-e82d002f5012 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:02.121581 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0572d292-d83e-48dc-88c9-e82d002f5012 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1285 microversion: 2.20 time: 0.112936 Aug 10 17:15:02.122169 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 39/75] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:02 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:02.879011 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2ee98662-6223-4ccf-90fb-c3e2f281879c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:02.879918 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2ee98662-6223-4ccf-90fb-c3e2f281879c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:02.893724 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ee98662-6223-4ccf-90fb-c3e2f281879c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:02.893724 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ee98662-6223-4ccf-90fb-c3e2f281879c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:02.893724 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ee98662-6223-4ccf-90fb-c3e2f281879c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:02.893724 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ee98662-6223-4ccf-90fb-c3e2f281879c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:02.894376 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ee98662-6223-4ccf-90fb-c3e2f281879c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:02.894376 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ee98662-6223-4ccf-90fb-c3e2f281879c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:02.916812 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0b124ace-aae0-4c88-94bd-71a885a71d95 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:02.918609 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0b124ace-aae0-4c88-94bd-71a885a71d95 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:02.933906 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0b124ace-aae0-4c88-94bd-71a885a71d95 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:02.936017 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0b124ace-aae0-4c88-94bd-71a885a71d95 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:02.939752 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0b124ace-aae0-4c88-94bd-71a885a71d95 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:02.939752 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0b124ace-aae0-4c88-94bd-71a885a71d95 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:02.939752 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0b124ace-aae0-4c88-94bd-71a885a71d95 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:02.939752 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0b124ace-aae0-4c88-94bd-71a885a71d95 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:02.971277 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:03.154602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2ee98662-6223-4ccf-90fb-c3e2f281879c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:03.169216 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2ee98662-6223-4ccf-90fb-c3e2f281879c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.294368 Aug 10 17:15:03.170261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 37/76] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:02 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:03.183503 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0b124ace-aae0-4c88-94bd-71a885a71d95 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:03.196758 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0b124ace-aae0-4c88-94bd-71a885a71d95 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.286766 Aug 10 17:15:03.197933 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 40/77] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:02 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:03.205342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5beb52d0-f640-4e9c-abfa-955ca79849c9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:03.209755 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5beb52d0-f640-4e9c-abfa-955ca79849c9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:03.209963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3728c577-182b-4bc7-a440-617e847440b6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:03.209963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3728c577-182b-4bc7-a440-617e847440b6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:03.217599 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5beb52d0-f640-4e9c-abfa-955ca79849c9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:03.218506 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5beb52d0-f640-4e9c-abfa-955ca79849c9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:03.219468 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5beb52d0-f640-4e9c-abfa-955ca79849c9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:03.220743 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5beb52d0-f640-4e9c-abfa-955ca79849c9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:03.221570 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5beb52d0-f640-4e9c-abfa-955ca79849c9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:03.222385 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5beb52d0-f640-4e9c-abfa-955ca79849c9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:03.223626 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3728c577-182b-4bc7-a440-617e847440b6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:03.224478 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3728c577-182b-4bc7-a440-617e847440b6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:03.225218 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3728c577-182b-4bc7-a440-617e847440b6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:03.226498 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3728c577-182b-4bc7-a440-617e847440b6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:03.227318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3728c577-182b-4bc7-a440-617e847440b6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:03.228047 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3728c577-182b-4bc7-a440-617e847440b6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:03.346863 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3728c577-182b-4bc7-a440-617e847440b6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:03.349234 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5beb52d0-f640-4e9c-abfa-955ca79849c9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:03.361565 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3728c577-182b-4bc7-a440-617e847440b6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1298 microversion: 2.1 time: 0.161182 Aug 10 17:15:03.362955 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 41/78] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:03 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1298 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:03.368042 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5beb52d0-f640-4e9c-abfa-955ca79849c9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1294 microversion: 2.1 time: 0.183470 Aug 10 17:15:03.378605 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-95c9f991-2b84-42db-8e7e-865e2012ad48 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:03.378605 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-95c9f991-2b84-42db-8e7e-865e2012ad48 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:03.378959 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 38/79] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:03 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1294 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:03.379102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95c9f991-2b84-42db-8e7e-865e2012ad48 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:03.379102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95c9f991-2b84-42db-8e7e-865e2012ad48 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:03.379102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95c9f991-2b84-42db-8e7e-865e2012ad48 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:03.379966 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95c9f991-2b84-42db-8e7e-865e2012ad48 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:03.381055 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95c9f991-2b84-42db-8e7e-865e2012ad48 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:03.381936 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95c9f991-2b84-42db-8e7e-865e2012ad48 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:03.479669 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-95c9f991-2b84-42db-8e7e-865e2012ad48 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:03.488397 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-95c9f991-2b84-42db-8e7e-865e2012ad48 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:03.490454 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-95c9f991-2b84-42db-8e7e-865e2012ad48 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:03.491130 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-95c9f991-2b84-42db-8e7e-865e2012ad48 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1285 microversion: 2.20 time: 0.127149 Aug 10 17:15:03.491694 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 42/80] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:03 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:04.213519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fc47fd8c-2873-408d-b568-c908564a7d7d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:04.214714 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fc47fd8c-2873-408d-b568-c908564a7d7d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:04.224515 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d0b08c33-7978-4d1b-b9c4-a834eaa2a5e9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:04.228999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d0b08c33-7978-4d1b-b9c4-a834eaa2a5e9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:04.229230 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fc47fd8c-2873-408d-b568-c908564a7d7d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:04.229230 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fc47fd8c-2873-408d-b568-c908564a7d7d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:04.229230 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fc47fd8c-2873-408d-b568-c908564a7d7d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:04.229900 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fc47fd8c-2873-408d-b568-c908564a7d7d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:04.230560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fc47fd8c-2873-408d-b568-c908564a7d7d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:04.231275 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fc47fd8c-2873-408d-b568-c908564a7d7d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:04.238741 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0b08c33-7978-4d1b-b9c4-a834eaa2a5e9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:04.239450 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0b08c33-7978-4d1b-b9c4-a834eaa2a5e9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:04.240115 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0b08c33-7978-4d1b-b9c4-a834eaa2a5e9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:04.241351 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0b08c33-7978-4d1b-b9c4-a834eaa2a5e9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:04.242381 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0b08c33-7978-4d1b-b9c4-a834eaa2a5e9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:04.243160 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0b08c33-7978-4d1b-b9c4-a834eaa2a5e9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:04.537009 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fc47fd8c-2873-408d-b568-c908564a7d7d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:04.547485 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fc47fd8c-2873-408d-b568-c908564a7d7d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.339767 Aug 10 17:15:04.548354 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 39/81] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:04 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:04.554530 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d0b08c33-7978-4d1b-b9c4-a834eaa2a5e9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:04.559008 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-82dd53d3-ce4e-4794-ad4a-20edc7157170 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:04.559677 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-82dd53d3-ce4e-4794-ad4a-20edc7157170 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:04.567792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-82dd53d3-ce4e-4794-ad4a-20edc7157170 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:04.576634 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-82dd53d3-ce4e-4794-ad4a-20edc7157170 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:04.576634 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-82dd53d3-ce4e-4794-ad4a-20edc7157170 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:04.576634 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-82dd53d3-ce4e-4794-ad4a-20edc7157170 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:04.576634 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-82dd53d3-ce4e-4794-ad4a-20edc7157170 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:04.577225 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d0b08c33-7978-4d1b-b9c4-a834eaa2a5e9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.353686 Aug 10 17:15:04.577389 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-82dd53d3-ce4e-4794-ad4a-20edc7157170 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:04.577530 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 43/82] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:04 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:04.580207 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fa8cab04-80d5-40de-a99b-e7d8281bce41 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:04.581417 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fa8cab04-80d5-40de-a99b-e7d8281bce41 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:04.592634 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa8cab04-80d5-40de-a99b-e7d8281bce41 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:04.593490 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa8cab04-80d5-40de-a99b-e7d8281bce41 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:04.594269 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa8cab04-80d5-40de-a99b-e7d8281bce41 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:04.595558 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa8cab04-80d5-40de-a99b-e7d8281bce41 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:04.596432 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa8cab04-80d5-40de-a99b-e7d8281bce41 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:04.597210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa8cab04-80d5-40de-a99b-e7d8281bce41 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:04.651840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-82dd53d3-ce4e-4794-ad4a-20edc7157170 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:04.665261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-82dd53d3-ce4e-4794-ad4a-20edc7157170 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1302 microversion: 2.1 time: 0.114845 Aug 10 17:15:04.667078 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 40/83] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:04 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1302 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:04.676556 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9434f978-95cc-4f18-bd66-1754870977f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:04.678461 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9434f978-95cc-4f18-bd66-1754870977f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:04.691922 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9434f978-95cc-4f18-bd66-1754870977f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:04.693225 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9434f978-95cc-4f18-bd66-1754870977f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:04.693776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9434f978-95cc-4f18-bd66-1754870977f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:04.698582 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9434f978-95cc-4f18-bd66-1754870977f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:04.698582 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9434f978-95cc-4f18-bd66-1754870977f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:04.698582 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9434f978-95cc-4f18-bd66-1754870977f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:04.736294 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fa8cab04-80d5-40de-a99b-e7d8281bce41 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:04.750575 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fa8cab04-80d5-40de-a99b-e7d8281bce41 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1298 microversion: 2.1 time: 0.177507 Aug 10 17:15:04.754230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 44/84] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:04 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1298 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:04.802558 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9434f978-95cc-4f18-bd66-1754870977f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:04.819970 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9434f978-95cc-4f18-bd66-1754870977f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:04.823275 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9434f978-95cc-4f18-bd66-1754870977f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:04.825229 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9434f978-95cc-4f18-bd66-1754870977f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1277 microversion: 2.20 time: 0.156352 Aug 10 17:15:04.839339 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 41/85] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:04 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:05.579873 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-96f0dcbc-2ff0-4b1f-9485-be4272c8f2e0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:05.580887 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-96f0dcbc-2ff0-4b1f-9485-be4272c8f2e0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:05.594971 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d412a371-9737-4293-819e-1a895ac427fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:05.595732 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d412a371-9737-4293-819e-1a895ac427fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:05.611489 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96f0dcbc-2ff0-4b1f-9485-be4272c8f2e0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:05.618484 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d412a371-9737-4293-819e-1a895ac427fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:05.620840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d412a371-9737-4293-819e-1a895ac427fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:05.621467 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96f0dcbc-2ff0-4b1f-9485-be4272c8f2e0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:05.622670 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d412a371-9737-4293-819e-1a895ac427fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:05.623590 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96f0dcbc-2ff0-4b1f-9485-be4272c8f2e0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:05.625371 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d412a371-9737-4293-819e-1a895ac427fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:05.626882 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96f0dcbc-2ff0-4b1f-9485-be4272c8f2e0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:05.627955 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d412a371-9737-4293-819e-1a895ac427fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:05.629725 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96f0dcbc-2ff0-4b1f-9485-be4272c8f2e0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:05.630936 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d412a371-9737-4293-819e-1a895ac427fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:05.631939 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96f0dcbc-2ff0-4b1f-9485-be4272c8f2e0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:05.891232 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-96f0dcbc-2ff0-4b1f-9485-be4272c8f2e0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:05.911477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d412a371-9737-4293-819e-1a895ac427fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:05.933644 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-96f0dcbc-2ff0-4b1f-9485-be4272c8f2e0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.361516 Aug 10 17:15:05.941449 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d412a371-9737-4293-819e-1a895ac427fd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.351336 Aug 10 17:15:05.953911 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 45/86] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:05 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:05.958866 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 42/87] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:05 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:05.974922 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6981823f-5929-4eed-95d1-cdc51aef69f3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:05.975441 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6981823f-5929-4eed-95d1-cdc51aef69f3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:05.986229 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8d662c74-6fe2-493e-9d71-3212d5409cf9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:05.987083 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8d662c74-6fe2-493e-9d71-3212d5409cf9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:05.991239 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6981823f-5929-4eed-95d1-cdc51aef69f3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:05.991239 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6981823f-5929-4eed-95d1-cdc51aef69f3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:05.991239 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6981823f-5929-4eed-95d1-cdc51aef69f3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:05.997139 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6981823f-5929-4eed-95d1-cdc51aef69f3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:05.997139 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6981823f-5929-4eed-95d1-cdc51aef69f3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:05.997139 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6981823f-5929-4eed-95d1-cdc51aef69f3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:06.001260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d662c74-6fe2-493e-9d71-3212d5409cf9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:06.001260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d662c74-6fe2-493e-9d71-3212d5409cf9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:06.001260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d662c74-6fe2-493e-9d71-3212d5409cf9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:06.001260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d662c74-6fe2-493e-9d71-3212d5409cf9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:06.002100 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d662c74-6fe2-493e-9d71-3212d5409cf9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:06.002323 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d662c74-6fe2-493e-9d71-3212d5409cf9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:06.034333 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:06.064705 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6981823f-5929-4eed-95d1-cdc51aef69f3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:06.081295 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6981823f-5929-4eed-95d1-cdc51aef69f3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1302 microversion: 2.1 time: 0.123076 Aug 10 17:15:06.087169 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 46/88] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:05 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1302 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:06.093150 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4dccdcbd-b512-422c-9429-39d263df344d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:06.093866 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4dccdcbd-b512-422c-9429-39d263df344d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:06.101091 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4dccdcbd-b512-422c-9429-39d263df344d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:06.101597 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4dccdcbd-b512-422c-9429-39d263df344d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:06.102056 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4dccdcbd-b512-422c-9429-39d263df344d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:06.102807 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4dccdcbd-b512-422c-9429-39d263df344d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:06.104010 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4dccdcbd-b512-422c-9429-39d263df344d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:06.104620 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4dccdcbd-b512-422c-9429-39d263df344d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:06.112881 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8d662c74-6fe2-493e-9d71-3212d5409cf9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:06.122471 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8d662c74-6fe2-493e-9d71-3212d5409cf9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1298 microversion: 2.1 time: 0.161284 Aug 10 17:15:06.123334 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 43/89] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:05 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1298 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:06.177864 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4dccdcbd-b512-422c-9429-39d263df344d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:06.191004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4dccdcbd-b512-422c-9429-39d263df344d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:06.192679 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4dccdcbd-b512-422c-9429-39d263df344d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:06.194063 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4dccdcbd-b512-422c-9429-39d263df344d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1277 microversion: 2.20 time: 0.105135 Aug 10 17:15:06.194998 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 47/90] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:06 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:06.980766 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-835dd503-a681-4645-ae2c-4ef05464ca90 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:06.981378 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-835dd503-a681-4645-ae2c-4ef05464ca90 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:06.984863 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=6 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:06.986942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=12 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:06.992814 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7e4dc8ee-d202-4a77-83bb-5c5c60c71586 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:06.994820 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7e4dc8ee-d202-4a77-83bb-5c5c60c71586 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:07.012799 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-835dd503-a681-4645-ae2c-4ef05464ca90 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:07.013315 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-835dd503-a681-4645-ae2c-4ef05464ca90 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:07.013762 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-835dd503-a681-4645-ae2c-4ef05464ca90 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:07.014526 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-835dd503-a681-4645-ae2c-4ef05464ca90 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:07.014987 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-835dd503-a681-4645-ae2c-4ef05464ca90 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:07.015419 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-835dd503-a681-4645-ae2c-4ef05464ca90 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:07.020933 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7e4dc8ee-d202-4a77-83bb-5c5c60c71586 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:07.021853 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7e4dc8ee-d202-4a77-83bb-5c5c60c71586 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:07.027745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7e4dc8ee-d202-4a77-83bb-5c5c60c71586 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:07.028953 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7e4dc8ee-d202-4a77-83bb-5c5c60c71586 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:07.029649 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7e4dc8ee-d202-4a77-83bb-5c5c60c71586 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:07.030544 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7e4dc8ee-d202-4a77-83bb-5c5c60c71586 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:07.303076 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=12 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:07.491224 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-835dd503-a681-4645-ae2c-4ef05464ca90 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:07.502658 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7e4dc8ee-d202-4a77-83bb-5c5c60c71586 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:07.507527 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-835dd503-a681-4645-ae2c-4ef05464ca90 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.531010 Aug 10 17:15:07.508615 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 44/91] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:06 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:07.519626 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7e4dc8ee-d202-4a77-83bb-5c5c60c71586 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.530687 Aug 10 17:15:07.520158 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-56ce7b06-3ad5-493c-9877-7fb8da0e7ceb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:07.521066 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-56ce7b06-3ad5-493c-9877-7fb8da0e7ceb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:07.521261 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 48/92] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:06 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:07.527567 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-657f0575-6801-4566-bb10-260eca14f1bf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:07.528825 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-657f0575-6801-4566-bb10-260eca14f1bf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:07.530371 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56ce7b06-3ad5-493c-9877-7fb8da0e7ceb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:07.530915 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56ce7b06-3ad5-493c-9877-7fb8da0e7ceb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:07.531353 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56ce7b06-3ad5-493c-9877-7fb8da0e7ceb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:07.532085 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56ce7b06-3ad5-493c-9877-7fb8da0e7ceb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:07.532579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56ce7b06-3ad5-493c-9877-7fb8da0e7ceb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:07.533097 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56ce7b06-3ad5-493c-9877-7fb8da0e7ceb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:07.537815 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-657f0575-6801-4566-bb10-260eca14f1bf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:07.538628 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-657f0575-6801-4566-bb10-260eca14f1bf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:07.539419 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-657f0575-6801-4566-bb10-260eca14f1bf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:07.540138 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-657f0575-6801-4566-bb10-260eca14f1bf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:07.540592 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-657f0575-6801-4566-bb10-260eca14f1bf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:07.541729 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-657f0575-6801-4566-bb10-260eca14f1bf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:07.629304 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-56ce7b06-3ad5-493c-9877-7fb8da0e7ceb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:07.646790 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-657f0575-6801-4566-bb10-260eca14f1bf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:07.651857 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-56ce7b06-3ad5-493c-9877-7fb8da0e7ceb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1300 microversion: 2.1 time: 0.141606 Aug 10 17:15:07.663909 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 45/93] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:07 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1300 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:07.663909 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3442044f-3fcd-48f5-b26b-2c124411bfde tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:07.663909 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3442044f-3fcd-48f5-b26b-2c124411bfde tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:07.664194 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-657f0575-6801-4566-bb10-260eca14f1bf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1296 microversion: 2.1 time: 0.138426 Aug 10 17:15:07.664559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3442044f-3fcd-48f5-b26b-2c124411bfde tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:07.665063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3442044f-3fcd-48f5-b26b-2c124411bfde tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:07.665508 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3442044f-3fcd-48f5-b26b-2c124411bfde tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:07.669073 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3442044f-3fcd-48f5-b26b-2c124411bfde tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:07.669073 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3442044f-3fcd-48f5-b26b-2c124411bfde tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:07.669073 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3442044f-3fcd-48f5-b26b-2c124411bfde tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:07.680588 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 49/94] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:07 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1296 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:07.768321 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3442044f-3fcd-48f5-b26b-2c124411bfde tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:07.788984 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3442044f-3fcd-48f5-b26b-2c124411bfde tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:07.792952 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3442044f-3fcd-48f5-b26b-2c124411bfde tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:07.794278 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3442044f-3fcd-48f5-b26b-2c124411bfde tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1341 microversion: 2.20 time: 0.140714 Aug 10 17:15:07.794891 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 46/95] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:07 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1341 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:08.549484 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3e25fa21-68f6-477e-afd1-cec690a254ef tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:08.550094 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3e25fa21-68f6-477e-afd1-cec690a254ef tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:08.551546 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7450daf1-895c-4e92-8c91-3dae74c1286d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:08.552177 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7450daf1-895c-4e92-8c91-3dae74c1286d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:08.574203 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e25fa21-68f6-477e-afd1-cec690a254ef tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:08.575135 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e25fa21-68f6-477e-afd1-cec690a254ef tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:08.576325 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e25fa21-68f6-477e-afd1-cec690a254ef tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:08.577408 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e25fa21-68f6-477e-afd1-cec690a254ef tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:08.578827 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e25fa21-68f6-477e-afd1-cec690a254ef tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:08.581770 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e25fa21-68f6-477e-afd1-cec690a254ef tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:08.581983 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7450daf1-895c-4e92-8c91-3dae74c1286d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:08.582713 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7450daf1-895c-4e92-8c91-3dae74c1286d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:08.585006 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7450daf1-895c-4e92-8c91-3dae74c1286d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:08.588433 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7450daf1-895c-4e92-8c91-3dae74c1286d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:08.591662 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7450daf1-895c-4e92-8c91-3dae74c1286d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:08.592706 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7450daf1-895c-4e92-8c91-3dae74c1286d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:08.966773 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3e25fa21-68f6-477e-afd1-cec690a254ef tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:08.985097 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3e25fa21-68f6-477e-afd1-cec690a254ef tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.445690 Aug 10 17:15:09.000815 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 50/96] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:08 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:09.027734 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5b2caa11-4813-4a8f-a19f-7dbc4cca9699 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:09.028633 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5b2caa11-4813-4a8f-a19f-7dbc4cca9699 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:09.036180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b2caa11-4813-4a8f-a19f-7dbc4cca9699 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:09.037073 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b2caa11-4813-4a8f-a19f-7dbc4cca9699 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:09.037733 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b2caa11-4813-4a8f-a19f-7dbc4cca9699 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:09.038722 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b2caa11-4813-4a8f-a19f-7dbc4cca9699 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:09.039455 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b2caa11-4813-4a8f-a19f-7dbc4cca9699 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:09.044934 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b2caa11-4813-4a8f-a19f-7dbc4cca9699 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:09.045087 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7450daf1-895c-4e92-8c91-3dae74c1286d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:09.057983 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7450daf1-895c-4e92-8c91-3dae74c1286d tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.516860 Aug 10 17:15:09.058957 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 47/97] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:08 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:09.081044 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-231708bd-fc5a-4cfb-8c8f-b2581639420a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:09.082801 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-231708bd-fc5a-4cfb-8c8f-b2581639420a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:09.102581 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-231708bd-fc5a-4cfb-8c8f-b2581639420a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:09.106178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-231708bd-fc5a-4cfb-8c8f-b2581639420a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:09.106341 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-231708bd-fc5a-4cfb-8c8f-b2581639420a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:09.108382 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-231708bd-fc5a-4cfb-8c8f-b2581639420a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:09.110864 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-231708bd-fc5a-4cfb-8c8f-b2581639420a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:09.111315 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-231708bd-fc5a-4cfb-8c8f-b2581639420a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:09.482966 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5b2caa11-4813-4a8f-a19f-7dbc4cca9699 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:09.492493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5b2caa11-4813-4a8f-a19f-7dbc4cca9699 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1368 microversion: 2.1 time: 0.478235 Aug 10 17:15:09.522389 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 51/98] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:09 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1368 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:09.530027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-75df08e8-7473-4ab9-919f-1ff402b53e95 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:09.531076 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-75df08e8-7473-4ab9-919f-1ff402b53e95 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:09.541097 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75df08e8-7473-4ab9-919f-1ff402b53e95 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:09.543049 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75df08e8-7473-4ab9-919f-1ff402b53e95 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:09.543870 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75df08e8-7473-4ab9-919f-1ff402b53e95 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:09.545298 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75df08e8-7473-4ab9-919f-1ff402b53e95 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:09.546229 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75df08e8-7473-4ab9-919f-1ff402b53e95 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:09.547081 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75df08e8-7473-4ab9-919f-1ff402b53e95 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:09.560265 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-231708bd-fc5a-4cfb-8c8f-b2581639420a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:09.574189 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-231708bd-fc5a-4cfb-8c8f-b2581639420a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1363 microversion: 2.1 time: 0.509304 Aug 10 17:15:09.575462 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 48/99] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:09 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1363 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:09.708596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-75df08e8-7473-4ab9-919f-1ff402b53e95 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:09.788577 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-75df08e8-7473-4ab9-919f-1ff402b53e95 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:09.798585 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-75df08e8-7473-4ab9-919f-1ff402b53e95 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:09.809601 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-75df08e8-7473-4ab9-919f-1ff402b53e95 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1339 microversion: 2.20 time: 0.281786 Aug 10 17:15:09.811528 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 52/100] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:09 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1339 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:10.013670 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-731fe7c1-7a27-4790-9bb6-1d886c171af1 req-82bd0ef8-fa22-4ea1-bd8b-da1120fbe337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffd37426-ce25-4561-91df-9058dc474b7d", "tag": "737c9bf5-5977-43d1-a5ab-0601f1af1149"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:15:10.056092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6071a2ee-582e-45e6-a428-ca055b99f305 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:10.064911 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-731fe7c1-7a27-4790-9bb6-1d886c171af1 req-82bd0ef8-fa22-4ea1-bd8b-da1120fbe337 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:10.064911 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-731fe7c1-7a27-4790-9bb6-1d886c171af1 req-82bd0ef8-fa22-4ea1-bd8b-da1120fbe337 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:10.064911 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-731fe7c1-7a27-4790-9bb6-1d886c171af1 req-82bd0ef8-fa22-4ea1-bd8b-da1120fbe337 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:10.065371 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6071a2ee-582e-45e6-a428-ca055b99f305 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:10.071186 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6071a2ee-582e-45e6-a428-ca055b99f305 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:10.074311 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-731fe7c1-7a27-4790-9bb6-1d886c171af1 req-82bd0ef8-fa22-4ea1-bd8b-da1120fbe337 service nova] Creating event network-changed:737c9bf5-5977-43d1-a5ab-0601f1af1149 for instance ffd37426-ce25-4561-91df-9058dc474b7d on hv-cinder-85272 Aug 10 17:15:10.075417 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6071a2ee-582e-45e6-a428-ca055b99f305 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:10.076166 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6071a2ee-582e-45e6-a428-ca055b99f305 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:10.077423 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6071a2ee-582e-45e6-a428-ca055b99f305 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:10.078237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6071a2ee-582e-45e6-a428-ca055b99f305 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:10.083029 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6071a2ee-582e-45e6-a428-ca055b99f305 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:10.083911 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-731fe7c1-7a27-4790-9bb6-1d886c171af1 req-82bd0ef8-fa22-4ea1-bd8b-da1120fbe337 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079845 Aug 10 17:15:10.092203 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 49/101] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:15:10.100101 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-17874c16-96ef-4732-b590-41f850fb44c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:10.104052 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-17874c16-96ef-4732-b590-41f850fb44c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:10.135292 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17874c16-96ef-4732-b590-41f850fb44c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:10.140716 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17874c16-96ef-4732-b590-41f850fb44c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:10.142273 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17874c16-96ef-4732-b590-41f850fb44c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:10.144887 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17874c16-96ef-4732-b590-41f850fb44c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:10.146014 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17874c16-96ef-4732-b590-41f850fb44c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:10.147136 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17874c16-96ef-4732-b590-41f850fb44c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:11.083553 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6071a2ee-582e-45e6-a428-ca055b99f305 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:11.084453 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-17874c16-96ef-4732-b590-41f850fb44c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:11.094883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-17874c16-96ef-4732-b590-41f850fb44c7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 1.001054 Aug 10 17:15:11.114768 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 50/102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:10 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:11.123822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-b5610263-7d4f-43b8-a2f7-f154734c8bd2 req-9ec651b1-e71d-456c-8d4d-7804c4ca2c89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a57e6be9-21bd-4903-a43c-425a17bf4029", "tag": "0726fc1d-a4ae-43f9-bb6e-44f5614c267e"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:15:11.125158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6071a2ee-582e-45e6-a428-ca055b99f305 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 1.096859 Aug 10 17:15:11.132115 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 53/103] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:10 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:11.167781 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-738ab7cb-8e6b-4980-8d5c-2cbc8fe82dc2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:11.167781 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-738ab7cb-8e6b-4980-8d5c-2cbc8fe82dc2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:11.174859 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b5610263-7d4f-43b8-a2f7-f154734c8bd2 req-9ec651b1-e71d-456c-8d4d-7804c4ca2c89 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:11.175923 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b5610263-7d4f-43b8-a2f7-f154734c8bd2 req-9ec651b1-e71d-456c-8d4d-7804c4ca2c89 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:11.179473 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b5610263-7d4f-43b8-a2f7-f154734c8bd2 req-9ec651b1-e71d-456c-8d4d-7804c4ca2c89 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:11.196473 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-738ab7cb-8e6b-4980-8d5c-2cbc8fe82dc2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:11.201696 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-738ab7cb-8e6b-4980-8d5c-2cbc8fe82dc2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:11.203786 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-738ab7cb-8e6b-4980-8d5c-2cbc8fe82dc2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:11.207632 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-738ab7cb-8e6b-4980-8d5c-2cbc8fe82dc2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:11.210505 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-738ab7cb-8e6b-4980-8d5c-2cbc8fe82dc2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:11.213604 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-738ab7cb-8e6b-4980-8d5c-2cbc8fe82dc2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:11.250235 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-b5610263-7d4f-43b8-a2f7-f154734c8bd2 req-9ec651b1-e71d-456c-8d4d-7804c4ca2c89 service nova] Creating event network-changed:0726fc1d-a4ae-43f9-bb6e-44f5614c267e for instance a57e6be9-21bd-4903-a43c-425a17bf4029 on hv-cinder-85272 Aug 10 17:15:11.264512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-b5610263-7d4f-43b8-a2f7-f154734c8bd2 req-9ec651b1-e71d-456c-8d4d-7804c4ca2c89 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148102 Aug 10 17:15:11.265401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 51/104] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:15:11.270791 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9f2ba487-b294-4e6a-aff2-052cd2e690f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:11.271511 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9f2ba487-b294-4e6a-aff2-052cd2e690f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:11.284475 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f2ba487-b294-4e6a-aff2-052cd2e690f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:11.284978 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f2ba487-b294-4e6a-aff2-052cd2e690f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:11.285422 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f2ba487-b294-4e6a-aff2-052cd2e690f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:11.286140 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f2ba487-b294-4e6a-aff2-052cd2e690f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:11.286818 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f2ba487-b294-4e6a-aff2-052cd2e690f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:11.287059 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f2ba487-b294-4e6a-aff2-052cd2e690f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:11.753147 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9f2ba487-b294-4e6a-aff2-052cd2e690f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:11.768223 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9f2ba487-b294-4e6a-aff2-052cd2e690f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1363 microversion: 2.1 time: 0.501288 Aug 10 17:15:11.770519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 52/105] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:11 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1363 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:11.790517 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-738ab7cb-8e6b-4980-8d5c-2cbc8fe82dc2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:11.819788 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2c0884f9-5b37-4855-9cb4-2f26c3277ecb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:11.819788 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2c0884f9-5b37-4855-9cb4-2f26c3277ecb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:11.820487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-738ab7cb-8e6b-4980-8d5c-2cbc8fe82dc2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1368 microversion: 2.1 time: 0.673321 Aug 10 17:15:11.820487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 54/106] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:11 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1368 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:11.820827 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2c0884f9-5b37-4855-9cb4-2f26c3277ecb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:11.820827 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2c0884f9-5b37-4855-9cb4-2f26c3277ecb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:11.820827 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2c0884f9-5b37-4855-9cb4-2f26c3277ecb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:11.820827 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2c0884f9-5b37-4855-9cb4-2f26c3277ecb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:11.821367 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2c0884f9-5b37-4855-9cb4-2f26c3277ecb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:11.821367 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2c0884f9-5b37-4855-9cb4-2f26c3277ecb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:12.130720 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ca9bd9de-2c4d-4a42-932b-dd9257b06a39 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:12.132063 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ca9bd9de-2c4d-4a42-932b-dd9257b06a39 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:12.159500 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca9bd9de-2c4d-4a42-932b-dd9257b06a39 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:12.160462 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca9bd9de-2c4d-4a42-932b-dd9257b06a39 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:12.161173 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca9bd9de-2c4d-4a42-932b-dd9257b06a39 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:12.167945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca9bd9de-2c4d-4a42-932b-dd9257b06a39 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:12.167945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca9bd9de-2c4d-4a42-932b-dd9257b06a39 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:12.170516 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca9bd9de-2c4d-4a42-932b-dd9257b06a39 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:12.209439 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2c0884f9-5b37-4855-9cb4-2f26c3277ecb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:12.261812 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2c0884f9-5b37-4855-9cb4-2f26c3277ecb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:12.264368 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2c0884f9-5b37-4855-9cb4-2f26c3277ecb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:12.265549 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2c0884f9-5b37-4855-9cb4-2f26c3277ecb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1405 microversion: 2.20 time: 0.493167 Aug 10 17:15:12.269911 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 53/107] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:11 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1405 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:12.280625 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-36e8bdd0-4613-456f-a317-de79adb179a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:12.282596 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-36e8bdd0-4613-456f-a317-de79adb179a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:12.295032 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-36e8bdd0-4613-456f-a317-de79adb179a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:12.295811 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-36e8bdd0-4613-456f-a317-de79adb179a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:12.296421 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-36e8bdd0-4613-456f-a317-de79adb179a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:12.297411 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-36e8bdd0-4613-456f-a317-de79adb179a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:12.298032 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-36e8bdd0-4613-456f-a317-de79adb179a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:12.298860 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-36e8bdd0-4613-456f-a317-de79adb179a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:12.725306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-36e8bdd0-4613-456f-a317-de79adb179a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:12.741787 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-36e8bdd0-4613-456f-a317-de79adb179a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.469805 Aug 10 17:15:12.742844 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 54/108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:12 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:12.751216 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ca9bd9de-2c4d-4a42-932b-dd9257b06a39 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:12.780114 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ca9bd9de-2c4d-4a42-932b-dd9257b06a39 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.665592 Aug 10 17:15:12.799193 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 55/109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:12 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:12.826661 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-077104ad-2a84-418a-960f-a1c46f62bbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:12.830821 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-077104ad-2a84-418a-960f-a1c46f62bbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:12.844464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-077104ad-2a84-418a-960f-a1c46f62bbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:12.848463 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-077104ad-2a84-418a-960f-a1c46f62bbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:12.849625 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-077104ad-2a84-418a-960f-a1c46f62bbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:12.850975 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-077104ad-2a84-418a-960f-a1c46f62bbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:12.851951 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-077104ad-2a84-418a-960f-a1c46f62bbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:12.852817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-077104ad-2a84-418a-960f-a1c46f62bbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:13.148676 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-e058b513-1ffa-4a84-82fc-9c6d847ac31d req-52e590a6-98cb-42e9-ada4-a1e95c4d6c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5e24ad-a791-4465-be5f-0b99c26f2655", "name": "network-vif-plugged", "status": "completed", "tag": "e9bdd79f-d6e0-4ff0-a545-38e482ce16a2"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:15:13.160324 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e058b513-1ffa-4a84-82fc-9c6d847ac31d req-52e590a6-98cb-42e9-ada4-a1e95c4d6c3d service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:13.161095 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e058b513-1ffa-4a84-82fc-9c6d847ac31d req-52e590a6-98cb-42e9-ada4-a1e95c4d6c3d service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:13.162844 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e058b513-1ffa-4a84-82fc-9c6d847ac31d req-52e590a6-98cb-42e9-ada4-a1e95c4d6c3d service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:13.187505 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-e058b513-1ffa-4a84-82fc-9c6d847ac31d req-52e590a6-98cb-42e9-ada4-a1e95c4d6c3d service nova] Creating event network-vif-plugged:e9bdd79f-d6e0-4ff0-a545-38e482ce16a2 for instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 on hv-cinder-85272 Aug 10 17:15:13.194123 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-e058b513-1ffa-4a84-82fc-9c6d847ac31d req-52e590a6-98cb-42e9-ada4-a1e95c4d6c3d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.449211 Aug 10 17:15:13.195112 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 55/110] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:15:13.205415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-05898ee6-73ab-41c0-bd46-1e0deceae2dc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:13.206458 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-05898ee6-73ab-41c0-bd46-1e0deceae2dc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:13.216939 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-05898ee6-73ab-41c0-bd46-1e0deceae2dc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:13.222729 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-05898ee6-73ab-41c0-bd46-1e0deceae2dc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:13.222729 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-05898ee6-73ab-41c0-bd46-1e0deceae2dc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:13.222729 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-05898ee6-73ab-41c0-bd46-1e0deceae2dc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:13.222729 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-05898ee6-73ab-41c0-bd46-1e0deceae2dc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:13.223288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-05898ee6-73ab-41c0-bd46-1e0deceae2dc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:13.418211 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-077104ad-2a84-418a-960f-a1c46f62bbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:13.419215 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:13.434622 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-077104ad-2a84-418a-960f-a1c46f62bbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1363 microversion: 2.1 time: 0.633054 Aug 10 17:15:13.435852 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 56/111] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:12 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1363 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:13.477420 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1644b855-f74b-4af6-803d-f398b2e06b3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:13.480028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1644b855-f74b-4af6-803d-f398b2e06b3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:13.492842 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1644b855-f74b-4af6-803d-f398b2e06b3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:13.494271 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1644b855-f74b-4af6-803d-f398b2e06b3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:13.495545 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1644b855-f74b-4af6-803d-f398b2e06b3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:13.496915 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1644b855-f74b-4af6-803d-f398b2e06b3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:13.497786 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1644b855-f74b-4af6-803d-f398b2e06b3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:13.498596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1644b855-f74b-4af6-803d-f398b2e06b3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:13.536098 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-05898ee6-73ab-41c0-bd46-1e0deceae2dc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:13.545961 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-05898ee6-73ab-41c0-bd46-1e0deceae2dc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1368 microversion: 2.1 time: 0.349039 Aug 10 17:15:13.560430 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 56/112] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:13 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1368 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:13.565796 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-742aef54-5a46-4372-87eb-3747c0f1169e req-fb98dade-aaf1-4ef2-a9b2-d01195b8a444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e46673f-6139-4b97-b57a-b65886eb16b1", "tag": "65857e53-de9a-43a1-9362-2d62644ab14a"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:15:13.577060 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-742aef54-5a46-4372-87eb-3747c0f1169e req-fb98dade-aaf1-4ef2-a9b2-d01195b8a444 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:13.577846 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-742aef54-5a46-4372-87eb-3747c0f1169e req-fb98dade-aaf1-4ef2-a9b2-d01195b8a444 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:13.578282 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-742aef54-5a46-4372-87eb-3747c0f1169e req-fb98dade-aaf1-4ef2-a9b2-d01195b8a444 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:13.600454 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-742aef54-5a46-4372-87eb-3747c0f1169e req-fb98dade-aaf1-4ef2-a9b2-d01195b8a444 service nova] Creating event network-changed:65857e53-de9a-43a1-9362-2d62644ab14a for instance 1e46673f-6139-4b97-b57a-b65886eb16b1 on hv-cinder-85272 Aug 10 17:15:13.654196 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-742aef54-5a46-4372-87eb-3747c0f1169e req-fb98dade-aaf1-4ef2-a9b2-d01195b8a444 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086460 Aug 10 17:15:13.656430 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 57/113] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:15:13.785227 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d49186ba-ed50-48e0-b4f9-a76a40a93952 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:13.786580 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d49186ba-ed50-48e0-b4f9-a76a40a93952 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:13.823302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d49186ba-ed50-48e0-b4f9-a76a40a93952 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:13.827562 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d49186ba-ed50-48e0-b4f9-a76a40a93952 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:13.827562 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d49186ba-ed50-48e0-b4f9-a76a40a93952 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:13.831774 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d49186ba-ed50-48e0-b4f9-a76a40a93952 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:13.832762 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d49186ba-ed50-48e0-b4f9-a76a40a93952 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:13.834453 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d49186ba-ed50-48e0-b4f9-a76a40a93952 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:14.153244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1644b855-f74b-4af6-803d-f398b2e06b3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:14.183027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1644b855-f74b-4af6-803d-f398b2e06b3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:14.196491 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1644b855-f74b-4af6-803d-f398b2e06b3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:14.200091 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1644b855-f74b-4af6-803d-f398b2e06b3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1405 microversion: 2.20 time: 0.762409 Aug 10 17:15:14.224276 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 57/114] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:13 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1405 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:14.249110 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-61711585-bb4e-43ba-a430-b97fb672b7b0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:14.255313 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-61711585-bb4e-43ba-a430-b97fb672b7b0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:14.264132 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61711585-bb4e-43ba-a430-b97fb672b7b0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:14.265429 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61711585-bb4e-43ba-a430-b97fb672b7b0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:14.265929 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61711585-bb4e-43ba-a430-b97fb672b7b0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:14.266785 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61711585-bb4e-43ba-a430-b97fb672b7b0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:14.267331 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61711585-bb4e-43ba-a430-b97fb672b7b0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:14.268056 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61711585-bb4e-43ba-a430-b97fb672b7b0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:14.511169 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d49186ba-ed50-48e0-b4f9-a76a40a93952 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:14.522887 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d49186ba-ed50-48e0-b4f9-a76a40a93952 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.747703 Aug 10 17:15:14.527935 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 58/115] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:13 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:14.539586 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e3fff48c-d1ec-4bd4-97b0-a10918ed51dd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:14.549092 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e3fff48c-d1ec-4bd4-97b0-a10918ed51dd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:14.564654 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e3fff48c-d1ec-4bd4-97b0-a10918ed51dd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:14.567648 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e3fff48c-d1ec-4bd4-97b0-a10918ed51dd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:14.568336 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e3fff48c-d1ec-4bd4-97b0-a10918ed51dd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:14.569210 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e3fff48c-d1ec-4bd4-97b0-a10918ed51dd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:14.573486 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e3fff48c-d1ec-4bd4-97b0-a10918ed51dd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:14.574098 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e3fff48c-d1ec-4bd4-97b0-a10918ed51dd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:14.597804 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-61711585-bb4e-43ba-a430-b97fb672b7b0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:14.617442 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-61711585-bb4e-43ba-a430-b97fb672b7b0 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.390806 Aug 10 17:15:14.639462 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 58/116] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:14 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:14.644866 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c2319df1-840c-498d-bc49-c930f2cf528a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:14.645850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c2319df1-840c-498d-bc49-c930f2cf528a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:14.656664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2319df1-840c-498d-bc49-c930f2cf528a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:14.657158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2319df1-840c-498d-bc49-c930f2cf528a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:14.659359 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2319df1-840c-498d-bc49-c930f2cf528a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:14.660344 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2319df1-840c-498d-bc49-c930f2cf528a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:14.660823 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2319df1-840c-498d-bc49-c930f2cf528a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:14.661277 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2319df1-840c-498d-bc49-c930f2cf528a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:14.911585 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e3fff48c-d1ec-4bd4-97b0-a10918ed51dd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:14.930312 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e3fff48c-d1ec-4bd4-97b0-a10918ed51dd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1363 microversion: 2.1 time: 0.390593 Aug 10 17:15:14.930312 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 59/117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:14 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:14.947411 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c2319df1-840c-498d-bc49-c930f2cf528a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:14.967461 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c2319df1-840c-498d-bc49-c930f2cf528a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1368 microversion: 2.1 time: 0.321860 Aug 10 17:15:14.967461 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 59/118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:14 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1368 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:15.212019 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-eac3078d-9564-4120-b428-7b0e5da16eff req-1c51d411-4f9a-4ef2-878b-1aef1b1159e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af2fcf04-eb83-455a-bb58-b8c23b16f58d", "name": "network-vif-plugged", "status": "completed", "tag": "b302d1cc-652d-4c9c-add6-c1dc1428f8c5"}, {"server_uuid": "df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb", "name": "network-vif-plugged", "status": "completed", "tag": "f385660a-21a4-436a-92ac-359d6c02f514"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:15:15.223756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-eac3078d-9564-4120-b428-7b0e5da16eff req-1c51d411-4f9a-4ef2-878b-1aef1b1159e5 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:15.227699 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-eac3078d-9564-4120-b428-7b0e5da16eff req-1c51d411-4f9a-4ef2-878b-1aef1b1159e5 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:15.227699 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-eac3078d-9564-4120-b428-7b0e5da16eff req-1c51d411-4f9a-4ef2-878b-1aef1b1159e5 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:15.248334 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-eac3078d-9564-4120-b428-7b0e5da16eff req-1c51d411-4f9a-4ef2-878b-1aef1b1159e5 service nova] Creating event network-vif-plugged:b302d1cc-652d-4c9c-add6-c1dc1428f8c5 for instance af2fcf04-eb83-455a-bb58-b8c23b16f58d on hv-cinder-85272 Aug 10 17:15:15.248855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1cb3411d-5305-4984-8427-3b89195d8128 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:15.249245 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-eac3078d-9564-4120-b428-7b0e5da16eff req-1c51d411-4f9a-4ef2-878b-1aef1b1159e5 service nova] Creating event network-vif-plugged:f385660a-21a4-436a-92ac-359d6c02f514 for instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb on hv-cinder-85272 Aug 10 17:15:15.249528 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1cb3411d-5305-4984-8427-3b89195d8128 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:15.252350 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:15.257010 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cb3411d-5305-4984-8427-3b89195d8128 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:15.257508 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cb3411d-5305-4984-8427-3b89195d8128 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:15.257963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cb3411d-5305-4984-8427-3b89195d8128 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:15.258749 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cb3411d-5305-4984-8427-3b89195d8128 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:15.259676 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cb3411d-5305-4984-8427-3b89195d8128 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:15.259846 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cb3411d-5305-4984-8427-3b89195d8128 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:15.261868 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-eac3078d-9564-4120-b428-7b0e5da16eff req-1c51d411-4f9a-4ef2-878b-1aef1b1159e5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053524 Aug 10 17:15:15.263056 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 60/119] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:15:15.527510 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1cb3411d-5305-4984-8427-3b89195d8128 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:15.550077 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1cb3411d-5305-4984-8427-3b89195d8128 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:15.553755 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1cb3411d-5305-4984-8427-3b89195d8128 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:15.569881 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6977bec1-f6f2-49c2-9066-0ec4db583eb5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:15.572304 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1cb3411d-5305-4984-8427-3b89195d8128 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1405 microversion: 2.20 time: 0.327843 Aug 10 17:15:15.573304 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 60/120] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:15 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1405 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:15:15.574461 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6977bec1-f6f2-49c2-9066-0ec4db583eb5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:15.589585 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6977bec1-f6f2-49c2-9066-0ec4db583eb5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:15.590795 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6977bec1-f6f2-49c2-9066-0ec4db583eb5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:15.591937 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6977bec1-f6f2-49c2-9066-0ec4db583eb5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:15.593282 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6977bec1-f6f2-49c2-9066-0ec4db583eb5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:15.595253 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6977bec1-f6f2-49c2-9066-0ec4db583eb5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:15.596380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6977bec1-f6f2-49c2-9066-0ec4db583eb5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:15.648271 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c3b9a5f7-0dcb-49ed-933d-98148ee77895 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:15.649496 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c3b9a5f7-0dcb-49ed-933d-98148ee77895 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:15.663566 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3b9a5f7-0dcb-49ed-933d-98148ee77895 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:15.667372 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3b9a5f7-0dcb-49ed-933d-98148ee77895 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:15.667876 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3b9a5f7-0dcb-49ed-933d-98148ee77895 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:15.669092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3b9a5f7-0dcb-49ed-933d-98148ee77895 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:15.669784 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3b9a5f7-0dcb-49ed-933d-98148ee77895 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:15.670268 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3b9a5f7-0dcb-49ed-933d-98148ee77895 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:15.862777 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6977bec1-f6f2-49c2-9066-0ec4db583eb5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:15.873229 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6977bec1-f6f2-49c2-9066-0ec4db583eb5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.316749 Aug 10 17:15:15.873822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 61/121] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:15 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:15.893949 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c3b9a5f7-0dcb-49ed-933d-98148ee77895 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:15.910092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c3b9a5f7-0dcb-49ed-933d-98148ee77895 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.268013 Aug 10 17:15:15.911461 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 61/122] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:15 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:15.950840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-76b09e03-ae4c-42c7-bb75-b178662be877 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:15.951892 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-76b09e03-ae4c-42c7-bb75-b178662be877 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:15.961665 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76b09e03-ae4c-42c7-bb75-b178662be877 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:15.963499 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76b09e03-ae4c-42c7-bb75-b178662be877 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:15.964476 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76b09e03-ae4c-42c7-bb75-b178662be877 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:15.965927 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76b09e03-ae4c-42c7-bb75-b178662be877 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:15.966905 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76b09e03-ae4c-42c7-bb75-b178662be877 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:15.967885 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76b09e03-ae4c-42c7-bb75-b178662be877 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:15.988295 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6bba4745-6693-4615-aac8-859d5ccb3bf1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:15.989111 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6bba4745-6693-4615-aac8-859d5ccb3bf1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:15.998901 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6bba4745-6693-4615-aac8-859d5ccb3bf1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:16.000079 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6bba4745-6693-4615-aac8-859d5ccb3bf1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:16.000806 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6bba4745-6693-4615-aac8-859d5ccb3bf1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:16.002222 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6bba4745-6693-4615-aac8-859d5ccb3bf1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:16.003104 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6bba4745-6693-4615-aac8-859d5ccb3bf1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:16.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6bba4745-6693-4615-aac8-859d5ccb3bf1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:16.326824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6bba4745-6693-4615-aac8-859d5ccb3bf1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:16.336972 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-76b09e03-ae4c-42c7-bb75-b178662be877 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:16.347505 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-76b09e03-ae4c-42c7-bb75-b178662be877 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1363 microversion: 2.1 time: 0.402076 Aug 10 17:15:16.348925 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 62/123] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:15 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:16.354196 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6bba4745-6693-4615-aac8-859d5ccb3bf1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1368 microversion: 2.1 time: 0.377479 Aug 10 17:15:16.355316 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 62/124] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:15 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1368 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:16.613670 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e0dda4c8-3b48-4834-8f3c-da9ddca48038 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:16.616584 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e0dda4c8-3b48-4834-8f3c-da9ddca48038 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:16.625566 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0dda4c8-3b48-4834-8f3c-da9ddca48038 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:16.626048 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0dda4c8-3b48-4834-8f3c-da9ddca48038 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:16.626517 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0dda4c8-3b48-4834-8f3c-da9ddca48038 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:16.627226 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0dda4c8-3b48-4834-8f3c-da9ddca48038 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:16.627685 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0dda4c8-3b48-4834-8f3c-da9ddca48038 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:16.628115 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0dda4c8-3b48-4834-8f3c-da9ddca48038 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:16.645191 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:16.780898 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e0dda4c8-3b48-4834-8f3c-da9ddca48038 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:16.794889 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e0dda4c8-3b48-4834-8f3c-da9ddca48038 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:16.794889 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e0dda4c8-3b48-4834-8f3c-da9ddca48038 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:16.795526 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e0dda4c8-3b48-4834-8f3c-da9ddca48038 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1405 microversion: 2.20 time: 0.188998 Aug 10 17:15:16.796097 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 63/125] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:16 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:16.909270 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-43f9f7d8-55ae-460d-9690-8654f1143329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:16.910063 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-43f9f7d8-55ae-460d-9690-8654f1143329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:16.918425 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43f9f7d8-55ae-460d-9690-8654f1143329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:16.919220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43f9f7d8-55ae-460d-9690-8654f1143329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:16.919701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43f9f7d8-55ae-460d-9690-8654f1143329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:16.920615 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43f9f7d8-55ae-460d-9690-8654f1143329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:16.921086 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43f9f7d8-55ae-460d-9690-8654f1143329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:16.921937 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43f9f7d8-55ae-460d-9690-8654f1143329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:16.932501 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-13a0cc47-d4a4-4ab2-8a27-5871cb764adf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:16.934047 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-13a0cc47-d4a4-4ab2-8a27-5871cb764adf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:16.941151 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13a0cc47-d4a4-4ab2-8a27-5871cb764adf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:16.942330 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13a0cc47-d4a4-4ab2-8a27-5871cb764adf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:16.943226 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13a0cc47-d4a4-4ab2-8a27-5871cb764adf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:16.944213 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13a0cc47-d4a4-4ab2-8a27-5871cb764adf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:16.944894 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13a0cc47-d4a4-4ab2-8a27-5871cb764adf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:16.945517 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13a0cc47-d4a4-4ab2-8a27-5871cb764adf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:17.215612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-43f9f7d8-55ae-460d-9690-8654f1143329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:17.221511 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-13a0cc47-d4a4-4ab2-8a27-5871cb764adf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:17.241242 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-13a0cc47-d4a4-4ab2-8a27-5871cb764adf tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1314 microversion: 2.1 time: 0.309913 Aug 10 17:15:17.241242 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 64/126] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:16 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:17.241432 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-43f9f7d8-55ae-460d-9690-8654f1143329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.336849 Aug 10 17:15:17.253849 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 63/127] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:16 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:17.378174 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6cfd539d-9533-473b-a0bd-f855f81051bb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:17.380086 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6cfd539d-9533-473b-a0bd-f855f81051bb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:17.385100 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bdb2fed2-0e9f-4632-8929-08637b9cc17e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:17.386215 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bdb2fed2-0e9f-4632-8929-08637b9cc17e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:17.390199 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cfd539d-9533-473b-a0bd-f855f81051bb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:17.391088 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cfd539d-9533-473b-a0bd-f855f81051bb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:17.391611 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cfd539d-9533-473b-a0bd-f855f81051bb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:17.392512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cfd539d-9533-473b-a0bd-f855f81051bb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:17.393919 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cfd539d-9533-473b-a0bd-f855f81051bb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:17.394405 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cfd539d-9533-473b-a0bd-f855f81051bb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:17.404479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdb2fed2-0e9f-4632-8929-08637b9cc17e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:17.405961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdb2fed2-0e9f-4632-8929-08637b9cc17e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:17.406776 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdb2fed2-0e9f-4632-8929-08637b9cc17e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:17.408261 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdb2fed2-0e9f-4632-8929-08637b9cc17e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:17.412983 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdb2fed2-0e9f-4632-8929-08637b9cc17e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:17.416045 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdb2fed2-0e9f-4632-8929-08637b9cc17e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:17.861285 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6cfd539d-9533-473b-a0bd-f855f81051bb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:17.878895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6cfd539d-9533-473b-a0bd-f855f81051bb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1363 microversion: 2.1 time: 0.506595 Aug 10 17:15:17.881153 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 65/128] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:17 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1363 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:17.898947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f47e25b5-2a48-4c0f-8c89-718313c336ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:17.899827 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f47e25b5-2a48-4c0f-8c89-718313c336ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:17.901972 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bdb2fed2-0e9f-4632-8929-08637b9cc17e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:17.910675 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bdb2fed2-0e9f-4632-8929-08637b9cc17e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1368 microversion: 2.1 time: 0.531445 Aug 10 17:15:17.911316 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 64/129] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:17 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1368 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:17.912933 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f47e25b5-2a48-4c0f-8c89-718313c336ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:17.913752 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f47e25b5-2a48-4c0f-8c89-718313c336ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:17.915183 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f47e25b5-2a48-4c0f-8c89-718313c336ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:17.917692 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f47e25b5-2a48-4c0f-8c89-718313c336ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:17.918850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f47e25b5-2a48-4c0f-8c89-718313c336ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:17.919472 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f47e25b5-2a48-4c0f-8c89-718313c336ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:17.966887 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-1abbeebf-7a44-41b9-b1b6-17e2e997232d req-b784df3d-9aeb-4a25-bc71-7136dd33f65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57e6be9-21bd-4903-a43c-425a17bf4029", "name": "network-vif-plugged", "status": "completed", "tag": "0726fc1d-a4ae-43f9-bb6e-44f5614c267e"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:15:17.982089 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-1abbeebf-7a44-41b9-b1b6-17e2e997232d req-b784df3d-9aeb-4a25-bc71-7136dd33f65f service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:17.982631 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-1abbeebf-7a44-41b9-b1b6-17e2e997232d req-b784df3d-9aeb-4a25-bc71-7136dd33f65f service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:17.983067 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-1abbeebf-7a44-41b9-b1b6-17e2e997232d req-b784df3d-9aeb-4a25-bc71-7136dd33f65f service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:17.996535 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-1abbeebf-7a44-41b9-b1b6-17e2e997232d req-b784df3d-9aeb-4a25-bc71-7136dd33f65f service nova] Creating event network-vif-plugged:0726fc1d-a4ae-43f9-bb6e-44f5614c267e for instance a57e6be9-21bd-4903-a43c-425a17bf4029 on hv-cinder-85272 Aug 10 17:15:18.003422 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-1abbeebf-7a44-41b9-b1b6-17e2e997232d req-b784df3d-9aeb-4a25-bc71-7136dd33f65f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042041 Aug 10 17:15:18.004358 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 65/130] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:15:18.095753 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f47e25b5-2a48-4c0f-8c89-718313c336ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:18.106515 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f47e25b5-2a48-4c0f-8c89-718313c336ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:18.108522 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f47e25b5-2a48-4c0f-8c89-718313c336ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:18.109668 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f47e25b5-2a48-4c0f-8c89-718313c336ac tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1405 microversion: 2.20 time: 0.227113 Aug 10 17:15:18.125032 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 66/131] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:17 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:18.267417 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-95340171-28d8-4a8f-9370-425608c4d4fc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:18.269071 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-95340171-28d8-4a8f-9370-425608c4d4fc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:18.277460 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d72fe0e1-4241-4bc0-9a87-227950e3e5f5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:18.278903 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d72fe0e1-4241-4bc0-9a87-227950e3e5f5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:18.280799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95340171-28d8-4a8f-9370-425608c4d4fc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:18.281931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95340171-28d8-4a8f-9370-425608c4d4fc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:18.282726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95340171-28d8-4a8f-9370-425608c4d4fc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:18.283750 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95340171-28d8-4a8f-9370-425608c4d4fc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:18.284630 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95340171-28d8-4a8f-9370-425608c4d4fc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:18.285617 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95340171-28d8-4a8f-9370-425608c4d4fc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:18.289397 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d72fe0e1-4241-4bc0-9a87-227950e3e5f5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:18.291226 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d72fe0e1-4241-4bc0-9a87-227950e3e5f5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:18.293204 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d72fe0e1-4241-4bc0-9a87-227950e3e5f5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:18.294109 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d72fe0e1-4241-4bc0-9a87-227950e3e5f5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:18.294762 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d72fe0e1-4241-4bc0-9a87-227950e3e5f5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:18.301354 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d72fe0e1-4241-4bc0-9a87-227950e3e5f5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:18.578725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d72fe0e1-4241-4bc0-9a87-227950e3e5f5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:18.582779 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-95340171-28d8-4a8f-9370-425608c4d4fc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:18.592439 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d72fe0e1-4241-4bc0-9a87-227950e3e5f5 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1500 microversion: 2.1 time: 0.321821 Aug 10 17:15:18.593426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 67/132] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:18 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1500 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:18.596068 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-95340171-28d8-4a8f-9370-425608c4d4fc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.336659 Aug 10 17:15:18.597072 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 66/133] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:18 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:18.903048 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6b796b59-2595-4efb-87de-3a4f9327b7ce tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:18.904207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6b796b59-2595-4efb-87de-3a4f9327b7ce tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:18.915780 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b796b59-2595-4efb-87de-3a4f9327b7ce tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:18.915780 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b796b59-2595-4efb-87de-3a4f9327b7ce tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:18.915780 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b796b59-2595-4efb-87de-3a4f9327b7ce tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:18.916797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b796b59-2595-4efb-87de-3a4f9327b7ce tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:18.917873 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b796b59-2595-4efb-87de-3a4f9327b7ce tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:18.919041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b796b59-2595-4efb-87de-3a4f9327b7ce tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:18.939787 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4eaf2577-80ab-4039-aaa5-7d02e65d5458 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:18.941756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4eaf2577-80ab-4039-aaa5-7d02e65d5458 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:18.953627 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4eaf2577-80ab-4039-aaa5-7d02e65d5458 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:18.954659 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4eaf2577-80ab-4039-aaa5-7d02e65d5458 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:18.955380 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4eaf2577-80ab-4039-aaa5-7d02e65d5458 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:18.957036 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4eaf2577-80ab-4039-aaa5-7d02e65d5458 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:18.958261 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4eaf2577-80ab-4039-aaa5-7d02e65d5458 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:18.959276 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4eaf2577-80ab-4039-aaa5-7d02e65d5458 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:19.211527 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6b796b59-2595-4efb-87de-3a4f9327b7ce tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:19.221762 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6b796b59-2595-4efb-87de-3a4f9327b7ce tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1363 microversion: 2.1 time: 0.324039 Aug 10 17:15:19.222573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 68/134] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:18 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:19.228073 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b1b77c5f-2c2e-47c0-8ae2-a91fcf302fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:19.229690 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b1b77c5f-2c2e-47c0-8ae2-a91fcf302fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:19.241270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b1b77c5f-2c2e-47c0-8ae2-a91fcf302fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:19.242229 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b1b77c5f-2c2e-47c0-8ae2-a91fcf302fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:19.243114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b1b77c5f-2c2e-47c0-8ae2-a91fcf302fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:19.245389 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b1b77c5f-2c2e-47c0-8ae2-a91fcf302fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:19.246579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b1b77c5f-2c2e-47c0-8ae2-a91fcf302fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:19.247650 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b1b77c5f-2c2e-47c0-8ae2-a91fcf302fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:19.266204 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4eaf2577-80ab-4039-aaa5-7d02e65d5458 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:19.280637 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4eaf2577-80ab-4039-aaa5-7d02e65d5458 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1368 microversion: 2.1 time: 0.348777 Aug 10 17:15:19.281940 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 67/135] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:18 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1368 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:19.505250 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b1b77c5f-2c2e-47c0-8ae2-a91fcf302fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:19.520115 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b1b77c5f-2c2e-47c0-8ae2-a91fcf302fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:19.522245 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b1b77c5f-2c2e-47c0-8ae2-a91fcf302fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:19.525873 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b1b77c5f-2c2e-47c0-8ae2-a91fcf302fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1405 microversion: 2.20 time: 0.299863 Aug 10 17:15:19.528959 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 69/136] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:19 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1405 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:19.637764 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-32c64cb0-a80f-4228-8a41-fcd8b119102d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:19.638796 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-32c64cb0-a80f-4228-8a41-fcd8b119102d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:19.651670 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32c64cb0-a80f-4228-8a41-fcd8b119102d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:19.652859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32c64cb0-a80f-4228-8a41-fcd8b119102d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:19.653671 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32c64cb0-a80f-4228-8a41-fcd8b119102d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:19.655079 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32c64cb0-a80f-4228-8a41-fcd8b119102d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:19.655916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32c64cb0-a80f-4228-8a41-fcd8b119102d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:19.656658 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32c64cb0-a80f-4228-8a41-fcd8b119102d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:19.830528 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-32c64cb0-a80f-4228-8a41-fcd8b119102d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:19.845144 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-32c64cb0-a80f-4228-8a41-fcd8b119102d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.218968 Aug 10 17:15:19.846182 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 68/137] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:19 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:20.245125 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-01420e8e-e5a1-4364-acdd-c3d1e5275d20 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:20.247225 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-01420e8e-e5a1-4364-acdd-c3d1e5275d20 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:20.257623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:20.276201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01420e8e-e5a1-4364-acdd-c3d1e5275d20 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:20.280318 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01420e8e-e5a1-4364-acdd-c3d1e5275d20 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:20.280660 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01420e8e-e5a1-4364-acdd-c3d1e5275d20 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:20.285668 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01420e8e-e5a1-4364-acdd-c3d1e5275d20 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:20.286764 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01420e8e-e5a1-4364-acdd-c3d1e5275d20 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:20.292128 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01420e8e-e5a1-4364-acdd-c3d1e5275d20 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:20.309259 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-524c8180-f696-4f3a-a366-e26791b260ce tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:20.310003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-524c8180-f696-4f3a-a366-e26791b260ce tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:20.348085 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-524c8180-f696-4f3a-a366-e26791b260ce tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:20.354532 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-524c8180-f696-4f3a-a366-e26791b260ce tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:20.354532 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-524c8180-f696-4f3a-a366-e26791b260ce tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:20.354532 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-524c8180-f696-4f3a-a366-e26791b260ce tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:20.354532 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-524c8180-f696-4f3a-a366-e26791b260ce tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:20.355100 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-524c8180-f696-4f3a-a366-e26791b260ce tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:20.803787 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-01420e8e-e5a1-4364-acdd-c3d1e5275d20 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:20.821877 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-01420e8e-e5a1-4364-acdd-c3d1e5275d20 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1363 microversion: 2.1 time: 0.582364 Aug 10 17:15:20.825223 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 70/138] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:20 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1363 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:20.842565 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9e91b7af-1c6d-45f3-8545-2fac0d95ac00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:20.844475 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9e91b7af-1c6d-45f3-8545-2fac0d95ac00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:20.859586 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e91b7af-1c6d-45f3-8545-2fac0d95ac00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:20.861493 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e91b7af-1c6d-45f3-8545-2fac0d95ac00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:20.863111 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e91b7af-1c6d-45f3-8545-2fac0d95ac00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:20.864696 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e91b7af-1c6d-45f3-8545-2fac0d95ac00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:20.866037 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e91b7af-1c6d-45f3-8545-2fac0d95ac00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:20.867145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e91b7af-1c6d-45f3-8545-2fac0d95ac00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:20.966472 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-524c8180-f696-4f3a-a366-e26791b260ce tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:20.977005 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-524c8180-f696-4f3a-a366-e26791b260ce tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1368 microversion: 2.1 time: 0.675861 Aug 10 17:15:20.977963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 69/139] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:20 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1368 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:20.983527 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-50fc67bf-5b69-487b-b697-ade0a543ecf1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:20.984514 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-50fc67bf-5b69-487b-b697-ade0a543ecf1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:20.992351 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50fc67bf-5b69-487b-b697-ade0a543ecf1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:20.993216 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50fc67bf-5b69-487b-b697-ade0a543ecf1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:20.993948 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50fc67bf-5b69-487b-b697-ade0a543ecf1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:20.996941 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50fc67bf-5b69-487b-b697-ade0a543ecf1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:20.997653 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50fc67bf-5b69-487b-b697-ade0a543ecf1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:20.998308 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50fc67bf-5b69-487b-b697-ade0a543ecf1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:21.109804 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9e91b7af-1c6d-45f3-8545-2fac0d95ac00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:21.118315 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9e91b7af-1c6d-45f3-8545-2fac0d95ac00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:21.119942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9e91b7af-1c6d-45f3-8545-2fac0d95ac00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:21.121113 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9e91b7af-1c6d-45f3-8545-2fac0d95ac00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1405 microversion: 2.20 time: 0.294208 Aug 10 17:15:21.121905 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 71/140] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:20 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1405 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:21.190300 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-50fc67bf-5b69-487b-b697-ade0a543ecf1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:21.199874 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-50fc67bf-5b69-487b-b697-ade0a543ecf1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1322 microversion: 2.1 time: 0.219880 Aug 10 17:15:21.203381 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 70/141] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:20 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:21.796995 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-af223516-92ce-4400-8aa2-e6604da0d7ae tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "548c24ab-d0ca-4bce-b888-721c15bdc3bd"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:15:21.803354 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-af223516-92ce-4400-8aa2-e6604da0d7ae tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:21.819738 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-af223516-92ce-4400-8aa2-e6604da0d7ae tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:21.820662 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-af223516-92ce-4400-8aa2-e6604da0d7ae tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:21.821449 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-af223516-92ce-4400-8aa2-e6604da0d7ae tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:21.823318 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-af223516-92ce-4400-8aa2-e6604da0d7ae tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:21.824179 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-af223516-92ce-4400-8aa2-e6604da0d7ae tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:21.824987 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-af223516-92ce-4400-8aa2-e6604da0d7ae tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:21.865300 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dc9683cd-5802-4303-b5ab-3def5daf631c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:21.867807 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dc9683cd-5802-4303-b5ab-3def5daf631c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:21.879471 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc9683cd-5802-4303-b5ab-3def5daf631c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:21.880362 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc9683cd-5802-4303-b5ab-3def5daf631c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:21.881328 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc9683cd-5802-4303-b5ab-3def5daf631c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:21.882449 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc9683cd-5802-4303-b5ab-3def5daf631c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:21.883244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc9683cd-5802-4303-b5ab-3def5daf631c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:21.884034 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc9683cd-5802-4303-b5ab-3def5daf631c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:22.093138 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dc9683cd-5802-4303-b5ab-3def5daf631c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:22.101332 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dc9683cd-5802-4303-b5ab-3def5daf631c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1363 microversion: 2.1 time: 0.243237 Aug 10 17:15:22.101919 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 71/142] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:21 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:22.107367 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-680ebfdb-18ad-4c7f-9c40-84099cdabbfe tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:22.107985 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-680ebfdb-18ad-4c7f-9c40-84099cdabbfe tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:22.114541 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-680ebfdb-18ad-4c7f-9c40-84099cdabbfe tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:22.115036 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-680ebfdb-18ad-4c7f-9c40-84099cdabbfe tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:22.119436 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-680ebfdb-18ad-4c7f-9c40-84099cdabbfe tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:22.119436 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-680ebfdb-18ad-4c7f-9c40-84099cdabbfe tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:22.119436 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-680ebfdb-18ad-4c7f-9c40-84099cdabbfe tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:22.119436 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-680ebfdb-18ad-4c7f-9c40-84099cdabbfe tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:22.313842 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-680ebfdb-18ad-4c7f-9c40-84099cdabbfe tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:22.324012 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-680ebfdb-18ad-4c7f-9c40-84099cdabbfe tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1368 microversion: 2.1 time: 0.220950 Aug 10 17:15:22.326988 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 72/143] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:22 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:22.348293 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3dd89cad-735a-4925-9a2a-5edd68760f81 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:22.349298 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3dd89cad-735a-4925-9a2a-5edd68760f81 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:22.357855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3dd89cad-735a-4925-9a2a-5edd68760f81 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:22.358774 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3dd89cad-735a-4925-9a2a-5edd68760f81 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:22.372393 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3dd89cad-735a-4925-9a2a-5edd68760f81 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:22.372393 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3dd89cad-735a-4925-9a2a-5edd68760f81 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:22.372393 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3dd89cad-735a-4925-9a2a-5edd68760f81 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:22.372393 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3dd89cad-735a-4925-9a2a-5edd68760f81 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:22.594779 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3dd89cad-735a-4925-9a2a-5edd68760f81 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:22.604097 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3dd89cad-735a-4925-9a2a-5edd68760f81 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:22.605767 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3dd89cad-735a-4925-9a2a-5edd68760f81 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:22.607068 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3dd89cad-735a-4925-9a2a-5edd68760f81 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1405 microversion: 2.20 time: 0.266139 Aug 10 17:15:22.607637 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 73/144] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:22 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:22.624764 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2fdde0ea-e415-4d2e-bcb2-2f211325e0e4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:22.625396 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2fdde0ea-e415-4d2e-bcb2-2f211325e0e4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:22.631883 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2fdde0ea-e415-4d2e-bcb2-2f211325e0e4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:22.633803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2fdde0ea-e415-4d2e-bcb2-2f211325e0e4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:22.633803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2fdde0ea-e415-4d2e-bcb2-2f211325e0e4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:22.633803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2fdde0ea-e415-4d2e-bcb2-2f211325e0e4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:22.634823 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2fdde0ea-e415-4d2e-bcb2-2f211325e0e4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:22.634956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2fdde0ea-e415-4d2e-bcb2-2f211325e0e4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:22.638657 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:22.832076 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2fdde0ea-e415-4d2e-bcb2-2f211325e0e4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:22.849203 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2fdde0ea-e415-4d2e-bcb2-2f211325e0e4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1515 microversion: 2.1 time: 0.239109 Aug 10 17:15:22.850632 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 74/145] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:22 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1515 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:22.856607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-1ef23835-6a78-43b6-98c6-9822c119a926 req-11c79d8b-7082-4891-a3d4-7841dc07c7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd37426-ce25-4561-91df-9058dc474b7d", "name": "network-vif-plugged", "status": "completed", "tag": "737c9bf5-5977-43d1-a5ab-0601f1af1149"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:15:22.868580 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-1ef23835-6a78-43b6-98c6-9822c119a926 req-11c79d8b-7082-4891-a3d4-7841dc07c7de service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:22.874706 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-1ef23835-6a78-43b6-98c6-9822c119a926 req-11c79d8b-7082-4891-a3d4-7841dc07c7de service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:22.874706 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-1ef23835-6a78-43b6-98c6-9822c119a926 req-11c79d8b-7082-4891-a3d4-7841dc07c7de service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:22.893751 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-1ef23835-6a78-43b6-98c6-9822c119a926 req-11c79d8b-7082-4891-a3d4-7841dc07c7de service nova] Creating event network-vif-plugged:737c9bf5-5977-43d1-a5ab-0601f1af1149 for instance ffd37426-ce25-4561-91df-9058dc474b7d on hv-cinder-85272 Aug 10 17:15:22.901816 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-1ef23835-6a78-43b6-98c6-9822c119a926 req-11c79d8b-7082-4891-a3d4-7841dc07c7de service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049085 Aug 10 17:15:22.903837 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 75/146] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:15:22.912323 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6dcf97c3-c58d-4afc-982b-d50d19e38664 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:15:22.916312 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6dcf97c3-c58d-4afc-982b-d50d19e38664 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:22.927035 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6dcf97c3-c58d-4afc-982b-d50d19e38664 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:22.938684 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6dcf97c3-c58d-4afc-982b-d50d19e38664 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:22.938684 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6dcf97c3-c58d-4afc-982b-d50d19e38664 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:22.938684 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6dcf97c3-c58d-4afc-982b-d50d19e38664 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:22.938684 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6dcf97c3-c58d-4afc-982b-d50d19e38664 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:22.939383 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6dcf97c3-c58d-4afc-982b-d50d19e38664 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:23.001558 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-6dcf97c3-c58d-4afc-982b-d50d19e38664 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lazy-loading 'flavor' on Instance uuid af2fcf04-eb83-455a-bb58-b8c23b16f58d {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:15:23.579073 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6dcf97c3-c58d-4afc-982b-d50d19e38664 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "POST /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d/action" status: 200 len: 32 microversion: 2.1 time: 0.674300 Aug 10 17:15:23.587369 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 76/147] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:15:22 2022] POST /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d/action => generated 32 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:15:23.587369 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-80ff37d6-87ff-4584-9745-74a4e2fa8a40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:23.587369 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-80ff37d6-87ff-4584-9745-74a4e2fa8a40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:23.594757 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80ff37d6-87ff-4584-9745-74a4e2fa8a40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:23.594757 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80ff37d6-87ff-4584-9745-74a4e2fa8a40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:23.594757 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80ff37d6-87ff-4584-9745-74a4e2fa8a40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:23.595351 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80ff37d6-87ff-4584-9745-74a4e2fa8a40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:23.595351 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80ff37d6-87ff-4584-9745-74a4e2fa8a40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:23.600455 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80ff37d6-87ff-4584-9745-74a4e2fa8a40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:23.802678 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-80ff37d6-87ff-4584-9745-74a4e2fa8a40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:23.814289 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-80ff37d6-87ff-4584-9745-74a4e2fa8a40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1363 microversion: 2.1 time: 0.233397 Aug 10 17:15:23.814928 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 77/148] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:23 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:23.819843 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-63d0d96f-a217-43e9-b243-26857ae54927 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:23.820458 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-63d0d96f-a217-43e9-b243-26857ae54927 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:23.832794 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d0d96f-a217-43e9-b243-26857ae54927 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:23.833377 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d0d96f-a217-43e9-b243-26857ae54927 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:23.833812 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d0d96f-a217-43e9-b243-26857ae54927 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:23.834593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d0d96f-a217-43e9-b243-26857ae54927 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:23.835047 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d0d96f-a217-43e9-b243-26857ae54927 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:23.835562 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d0d96f-a217-43e9-b243-26857ae54927 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:24.026171 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-63d0d96f-a217-43e9-b243-26857ae54927 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:24.034334 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-63d0d96f-a217-43e9-b243-26857ae54927 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1368 microversion: 2.1 time: 0.218183 Aug 10 17:15:24.034945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 78/149] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:23 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:24.055403 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9acff55a-0ba6-47e3-ab3e-ea77d3132379 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:24.055403 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9acff55a-0ba6-47e3-ab3e-ea77d3132379 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:24.062945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9acff55a-0ba6-47e3-ab3e-ea77d3132379 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:24.063439 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9acff55a-0ba6-47e3-ab3e-ea77d3132379 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:24.063999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9acff55a-0ba6-47e3-ab3e-ea77d3132379 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:24.064860 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9acff55a-0ba6-47e3-ab3e-ea77d3132379 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:24.065315 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9acff55a-0ba6-47e3-ab3e-ea77d3132379 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:24.065740 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9acff55a-0ba6-47e3-ab3e-ea77d3132379 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:24.270288 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9acff55a-0ba6-47e3-ab3e-ea77d3132379 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:24.279026 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9acff55a-0ba6-47e3-ab3e-ea77d3132379 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.233215 Aug 10 17:15:24.279687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 79/150] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:24 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:24.287810 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8c6c316c-af48-41a3-9154-cb45bcbacf16 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:24.288698 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8c6c316c-af48-41a3-9154-cb45bcbacf16 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:24.296916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c6c316c-af48-41a3-9154-cb45bcbacf16 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:24.297602 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c6c316c-af48-41a3-9154-cb45bcbacf16 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:24.298313 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c6c316c-af48-41a3-9154-cb45bcbacf16 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:24.299430 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c6c316c-af48-41a3-9154-cb45bcbacf16 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:24.299990 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c6c316c-af48-41a3-9154-cb45bcbacf16 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:24.300577 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c6c316c-af48-41a3-9154-cb45bcbacf16 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:24.524871 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8c6c316c-af48-41a3-9154-cb45bcbacf16 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:24.543698 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8c6c316c-af48-41a3-9154-cb45bcbacf16 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:24.547115 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8c6c316c-af48-41a3-9154-cb45bcbacf16 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:24.549504 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8c6c316c-af48-41a3-9154-cb45bcbacf16 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1405 microversion: 2.20 time: 0.268378 Aug 10 17:15:24.550838 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 80/151] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:24 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:24.851493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a5b0797f-c3ce-4922-ad7c-8156a554c65b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:24.852149 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a5b0797f-c3ce-4922-ad7c-8156a554c65b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:24.861074 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5b0797f-c3ce-4922-ad7c-8156a554c65b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:24.861729 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5b0797f-c3ce-4922-ad7c-8156a554c65b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:24.862538 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5b0797f-c3ce-4922-ad7c-8156a554c65b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:24.863568 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5b0797f-c3ce-4922-ad7c-8156a554c65b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:24.864483 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5b0797f-c3ce-4922-ad7c-8156a554c65b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:24.864782 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5b0797f-c3ce-4922-ad7c-8156a554c65b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:25.038838 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a5b0797f-c3ce-4922-ad7c-8156a554c65b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:25.046943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a5b0797f-c3ce-4922-ad7c-8156a554c65b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1363 microversion: 2.1 time: 0.200401 Aug 10 17:15:25.047537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 81/152] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:24 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:25.052086 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-05a00084-582e-4b11-9fc5-70627fa9988b req-54f601d4-028c-426f-82aa-0afb71929530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e46673f-6139-4b97-b57a-b65886eb16b1", "name": "network-vif-plugged", "status": "completed", "tag": "65857e53-de9a-43a1-9362-2d62644ab14a"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:15:25.064547 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-05a00084-582e-4b11-9fc5-70627fa9988b req-54f601d4-028c-426f-82aa-0afb71929530 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:25.065089 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-05a00084-582e-4b11-9fc5-70627fa9988b req-54f601d4-028c-426f-82aa-0afb71929530 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:25.065682 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-05a00084-582e-4b11-9fc5-70627fa9988b req-54f601d4-028c-426f-82aa-0afb71929530 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:25.082088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-05a00084-582e-4b11-9fc5-70627fa9988b req-54f601d4-028c-426f-82aa-0afb71929530 service nova] Creating event network-vif-plugged:65857e53-de9a-43a1-9362-2d62644ab14a for instance 1e46673f-6139-4b97-b57a-b65886eb16b1 on hv-cinder-85272 Aug 10 17:15:25.089608 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-05a00084-582e-4b11-9fc5-70627fa9988b req-54f601d4-028c-426f-82aa-0afb71929530 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040345 Aug 10 17:15:25.091210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 82/153] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:15:25.097901 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d0ef47fe-c39f-46da-be62-33df04fd65b8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:25.098652 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d0ef47fe-c39f-46da-be62-33df04fd65b8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:25.109970 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0ef47fe-c39f-46da-be62-33df04fd65b8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:25.112410 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0ef47fe-c39f-46da-be62-33df04fd65b8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:25.112410 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0ef47fe-c39f-46da-be62-33df04fd65b8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:25.112410 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0ef47fe-c39f-46da-be62-33df04fd65b8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:25.113360 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0ef47fe-c39f-46da-be62-33df04fd65b8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:25.113360 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0ef47fe-c39f-46da-be62-33df04fd65b8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:25.330917 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d0ef47fe-c39f-46da-be62-33df04fd65b8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:25.351579 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d0ef47fe-c39f-46da-be62-33df04fd65b8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1557 microversion: 2.1 time: 0.258388 Aug 10 17:15:25.354068 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 83/154] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:25 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1557 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:25.364346 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-495c881f-7cfc-4965-a587-44144968e108 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:25.365821 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-495c881f-7cfc-4965-a587-44144968e108 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:25.378842 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-495c881f-7cfc-4965-a587-44144968e108 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:25.379947 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-495c881f-7cfc-4965-a587-44144968e108 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:25.380931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-495c881f-7cfc-4965-a587-44144968e108 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:25.382465 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-495c881f-7cfc-4965-a587-44144968e108 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:25.383709 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-495c881f-7cfc-4965-a587-44144968e108 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:25.384945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-495c881f-7cfc-4965-a587-44144968e108 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:25.575483 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-495c881f-7cfc-4965-a587-44144968e108 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:25.585687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-495c881f-7cfc-4965-a587-44144968e108 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.229313 Aug 10 17:15:25.586929 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 84/155] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:25 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:25.596149 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0d0745d0-1efd-420f-848b-f9c169dc4124 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:25.597044 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0d0745d0-1efd-420f-848b-f9c169dc4124 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:25.622654 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d0745d0-1efd-420f-848b-f9c169dc4124 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:25.623860 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d0745d0-1efd-420f-848b-f9c169dc4124 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:25.630328 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d0745d0-1efd-420f-848b-f9c169dc4124 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:25.631572 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d0745d0-1efd-420f-848b-f9c169dc4124 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:25.632431 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d0745d0-1efd-420f-848b-f9c169dc4124 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:25.651070 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d0745d0-1efd-420f-848b-f9c169dc4124 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:25.835286 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0d0745d0-1efd-420f-848b-f9c169dc4124 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.246525 Aug 10 17:15:25.839805 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 85/156] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 17:15:25 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029/os-interface => generated 284 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:15:25.853554 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9711f9c2-da07-4655-a1b1-47c3d57236a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:25.854963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9711f9c2-da07-4655-a1b1-47c3d57236a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:25.866873 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9711f9c2-da07-4655-a1b1-47c3d57236a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:25.868359 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9711f9c2-da07-4655-a1b1-47c3d57236a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:25.879516 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9711f9c2-da07-4655-a1b1-47c3d57236a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:25.881012 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9711f9c2-da07-4655-a1b1-47c3d57236a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:25.881508 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9711f9c2-da07-4655-a1b1-47c3d57236a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:25.881957 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9711f9c2-da07-4655-a1b1-47c3d57236a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:26.057355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9711f9c2-da07-4655-a1b1-47c3d57236a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:26.067897 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9711f9c2-da07-4655-a1b1-47c3d57236a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:26.069928 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9711f9c2-da07-4655-a1b1-47c3d57236a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:26.071242 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9711f9c2-da07-4655-a1b1-47c3d57236a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1405 microversion: 2.20 time: 0.229737 Aug 10 17:15:26.072512 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 86/157] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:25 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:26.080110 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-97e4b846-9de6-4771-94d6-900e5676339d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:26.081158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-97e4b846-9de6-4771-94d6-900e5676339d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:26.088538 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97e4b846-9de6-4771-94d6-900e5676339d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:26.089425 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97e4b846-9de6-4771-94d6-900e5676339d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:26.090096 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97e4b846-9de6-4771-94d6-900e5676339d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:26.091086 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97e4b846-9de6-4771-94d6-900e5676339d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:26.091901 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97e4b846-9de6-4771-94d6-900e5676339d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:26.092556 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97e4b846-9de6-4771-94d6-900e5676339d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:26.176566 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-af223516-92ce-4400-8aa2-e6604da0d7ae tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "POST /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.387506 Aug 10 17:15:26.177216 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 72/158] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 17:15:21 2022] POST /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655/os-volume_attachments => generated 194 bytes in 4389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:15:26.277261 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-97e4b846-9de6-4771-94d6-900e5676339d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:26.286424 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-97e4b846-9de6-4771-94d6-900e5676339d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1363 microversion: 2.1 time: 0.211790 Aug 10 17:15:26.287484 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 87/159] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:26 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:26.622532 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fd02fbe5-5ee0-41c4-8b09-53d6538f91c7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:26.623268 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fd02fbe5-5ee0-41c4-8b09-53d6538f91c7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:26.630208 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd02fbe5-5ee0-41c4-8b09-53d6538f91c7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:26.630750 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd02fbe5-5ee0-41c4-8b09-53d6538f91c7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:26.631198 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd02fbe5-5ee0-41c4-8b09-53d6538f91c7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:26.631932 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd02fbe5-5ee0-41c4-8b09-53d6538f91c7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:26.632396 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd02fbe5-5ee0-41c4-8b09-53d6538f91c7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:26.632829 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd02fbe5-5ee0-41c4-8b09-53d6538f91c7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:26.811052 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fd02fbe5-5ee0-41c4-8b09-53d6538f91c7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:26.820924 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fd02fbe5-5ee0-41c4-8b09-53d6538f91c7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.205800 Aug 10 17:15:26.821425 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 73/160] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:26 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:27.112322 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6343ab79-fc22-468f-815f-12b6bc0e432c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:27.112932 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6343ab79-fc22-468f-815f-12b6bc0e432c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:27.121163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6343ab79-fc22-468f-815f-12b6bc0e432c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:27.124318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6343ab79-fc22-468f-815f-12b6bc0e432c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:27.124318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6343ab79-fc22-468f-815f-12b6bc0e432c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:27.124318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6343ab79-fc22-468f-815f-12b6bc0e432c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:27.124318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6343ab79-fc22-468f-815f-12b6bc0e432c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:27.124868 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6343ab79-fc22-468f-815f-12b6bc0e432c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:27.306564 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6343ab79-fc22-468f-815f-12b6bc0e432c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:27.323921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-aaa8800b-251f-4344-b481-276077bbeeb3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:27.324961 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-aaa8800b-251f-4344-b481-276077bbeeb3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:27.335407 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6343ab79-fc22-468f-815f-12b6bc0e432c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:27.340939 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6343ab79-fc22-468f-815f-12b6bc0e432c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:27.344035 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6343ab79-fc22-468f-815f-12b6bc0e432c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1405 microversion: 2.20 time: 0.235210 Aug 10 17:15:27.350872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aaa8800b-251f-4344-b481-276077bbeeb3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:27.351958 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aaa8800b-251f-4344-b481-276077bbeeb3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:27.355445 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aaa8800b-251f-4344-b481-276077bbeeb3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:27.359288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aaa8800b-251f-4344-b481-276077bbeeb3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:27.362343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aaa8800b-251f-4344-b481-276077bbeeb3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:27.363854 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 88/161] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:27 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:15:27.366553 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aaa8800b-251f-4344-b481-276077bbeeb3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:27.582299 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-aaa8800b-251f-4344-b481-276077bbeeb3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:27.605794 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-aaa8800b-251f-4344-b481-276077bbeeb3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1363 microversion: 2.1 time: 0.279557 Aug 10 17:15:27.627913 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 74/162] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:27 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:27.856250 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8b8ee093-91b4-4da7-8b8e-344da613802f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:27.856922 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8b8ee093-91b4-4da7-8b8e-344da613802f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:27.868265 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b8ee093-91b4-4da7-8b8e-344da613802f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:27.870394 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b8ee093-91b4-4da7-8b8e-344da613802f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:27.870895 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b8ee093-91b4-4da7-8b8e-344da613802f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:27.874233 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b8ee093-91b4-4da7-8b8e-344da613802f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:27.876051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b8ee093-91b4-4da7-8b8e-344da613802f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:27.876520 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b8ee093-91b4-4da7-8b8e-344da613802f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:27.988922 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-d51c41f6-e2ff-47ce-9446-eaf47067e386 req-979dd589-a06e-4c6e-839c-87ec798d2b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a57e6be9-21bd-4903-a43c-425a17bf4029", "tag": "0726fc1d-a4ae-43f9-bb6e-44f5614c267e"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:15:28.023080 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-d51c41f6-e2ff-47ce-9446-eaf47067e386 req-979dd589-a06e-4c6e-839c-87ec798d2b5e service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:28.025408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-d51c41f6-e2ff-47ce-9446-eaf47067e386 req-979dd589-a06e-4c6e-839c-87ec798d2b5e service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:28.028961 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-d51c41f6-e2ff-47ce-9446-eaf47067e386 req-979dd589-a06e-4c6e-839c-87ec798d2b5e service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:28.062286 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-d51c41f6-e2ff-47ce-9446-eaf47067e386 req-979dd589-a06e-4c6e-839c-87ec798d2b5e service nova] Creating event network-changed:0726fc1d-a4ae-43f9-bb6e-44f5614c267e for instance a57e6be9-21bd-4903-a43c-425a17bf4029 on hv-cinder-85272 Aug 10 17:15:28.084124 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-d51c41f6-e2ff-47ce-9446-eaf47067e386 req-979dd589-a06e-4c6e-839c-87ec798d2b5e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097103 Aug 10 17:15:28.090327 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 75/163] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:15:28.153066 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8b8ee093-91b4-4da7-8b8e-344da613802f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:28.161280 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8b8ee093-91b4-4da7-8b8e-344da613802f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.310902 Aug 10 17:15:28.161873 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 89/164] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:27 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:28.386884 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5cd25f6a-dedb-42c3-8157-db3afe7425c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:28.387870 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5cd25f6a-dedb-42c3-8157-db3afe7425c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:28.405019 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5cd25f6a-dedb-42c3-8157-db3afe7425c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:28.405526 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5cd25f6a-dedb-42c3-8157-db3afe7425c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:28.405988 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5cd25f6a-dedb-42c3-8157-db3afe7425c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:28.406763 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5cd25f6a-dedb-42c3-8157-db3afe7425c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:28.407252 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5cd25f6a-dedb-42c3-8157-db3afe7425c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:28.407760 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5cd25f6a-dedb-42c3-8157-db3afe7425c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:28.673079 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-69e70328-6aac-4e86-b5ce-6ec7456d004d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:28.694148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-69e70328-6aac-4e86-b5ce-6ec7456d004d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:28.696785 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69e70328-6aac-4e86-b5ce-6ec7456d004d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:28.705447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69e70328-6aac-4e86-b5ce-6ec7456d004d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:28.706267 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69e70328-6aac-4e86-b5ce-6ec7456d004d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:28.712434 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69e70328-6aac-4e86-b5ce-6ec7456d004d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:28.713827 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69e70328-6aac-4e86-b5ce-6ec7456d004d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:28.714842 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69e70328-6aac-4e86-b5ce-6ec7456d004d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:28.783876 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:28.909716 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5cd25f6a-dedb-42c3-8157-db3afe7425c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:28.928005 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5cd25f6a-dedb-42c3-8157-db3afe7425c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:28.934727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5cd25f6a-dedb-42c3-8157-db3afe7425c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:28.938391 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5cd25f6a-dedb-42c3-8157-db3afe7425c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1596 microversion: 2.20 time: 0.555413 Aug 10 17:15:28.944713 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 76/165] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:15:28 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1596 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:15:29.015669 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-649654b1-fe9a-4f23-88fd-e7cff7c5f088 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:29.016199 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-649654b1-fe9a-4f23-88fd-e7cff7c5f088 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:29.054536 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-649654b1-fe9a-4f23-88fd-e7cff7c5f088 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:29.054536 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-649654b1-fe9a-4f23-88fd-e7cff7c5f088 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:29.054536 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-649654b1-fe9a-4f23-88fd-e7cff7c5f088 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:29.054536 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-649654b1-fe9a-4f23-88fd-e7cff7c5f088 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:29.055577 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-649654b1-fe9a-4f23-88fd-e7cff7c5f088 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:29.055577 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-649654b1-fe9a-4f23-88fd-e7cff7c5f088 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:29.061964 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-69e70328-6aac-4e86-b5ce-6ec7456d004d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:29.080109 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-69e70328-6aac-4e86-b5ce-6ec7456d004d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1363 microversion: 2.1 time: 0.413827 Aug 10 17:15:29.083321 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 90/166] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:28 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1363 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:29.176527 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-649654b1-fe9a-4f23-88fd-e7cff7c5f088 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.194708 Aug 10 17:15:29.177478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 77/167] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Aug 10 17:15:28 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:15:29.185367 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-56344116-d488-437c-87b2-92ac8c7c649a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:29.187028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-56344116-d488-437c-87b2-92ac8c7c649a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:29.199925 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56344116-d488-437c-87b2-92ac8c7c649a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:29.201098 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56344116-d488-437c-87b2-92ac8c7c649a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:29.202186 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56344116-d488-437c-87b2-92ac8c7c649a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:29.203501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56344116-d488-437c-87b2-92ac8c7c649a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:29.204550 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56344116-d488-437c-87b2-92ac8c7c649a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:29.205541 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56344116-d488-437c-87b2-92ac8c7c649a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:29.753259 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-56344116-d488-437c-87b2-92ac8c7c649a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:29.785181 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-56344116-d488-437c-87b2-92ac8c7c649a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.605140 Aug 10 17:15:29.798387 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 91/168] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:29 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:30.112292 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-14f10410-412c-4de5-b272-3ff529ead08c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:30.113448 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-14f10410-412c-4de5-b272-3ff529ead08c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:30.144720 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-14f10410-412c-4de5-b272-3ff529ead08c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:30.145909 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-14f10410-412c-4de5-b272-3ff529ead08c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:30.147168 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-14f10410-412c-4de5-b272-3ff529ead08c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:30.149011 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-14f10410-412c-4de5-b272-3ff529ead08c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:30.150076 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-14f10410-412c-4de5-b272-3ff529ead08c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:30.151106 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-14f10410-412c-4de5-b272-3ff529ead08c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:30.827576 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-82ea145c-b170-4eec-b929-18e70119d540 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:30.831076 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-82ea145c-b170-4eec-b929-18e70119d540 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:30.848627 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82ea145c-b170-4eec-b929-18e70119d540 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:30.852347 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82ea145c-b170-4eec-b929-18e70119d540 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:30.852347 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82ea145c-b170-4eec-b929-18e70119d540 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:30.852347 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82ea145c-b170-4eec-b929-18e70119d540 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:30.854379 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82ea145c-b170-4eec-b929-18e70119d540 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:30.855418 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82ea145c-b170-4eec-b929-18e70119d540 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:31.283442 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-14f10410-412c-4de5-b272-3ff529ead08c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:31.294100 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-82ea145c-b170-4eec-b929-18e70119d540 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:31.313257 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-82ea145c-b170-4eec-b929-18e70119d540 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.497959 Aug 10 17:15:31.313861 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 92/169] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:30 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:31.317495 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-14f10410-412c-4de5-b272-3ff529ead08c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1549 microversion: 2.1 time: 1.213697 Aug 10 17:15:31.322516 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 78/170] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:30 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1549 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:31.347417 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fe800f06-7baf-47b7-aea9-ef8204b5a670 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:31.348023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fe800f06-7baf-47b7-aea9-ef8204b5a670 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:31.356418 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe800f06-7baf-47b7-aea9-ef8204b5a670 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:31.362129 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe800f06-7baf-47b7-aea9-ef8204b5a670 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:31.362129 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe800f06-7baf-47b7-aea9-ef8204b5a670 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:31.362129 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe800f06-7baf-47b7-aea9-ef8204b5a670 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:31.362129 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe800f06-7baf-47b7-aea9-ef8204b5a670 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:31.362642 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe800f06-7baf-47b7-aea9-ef8204b5a670 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:31.662264 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fe800f06-7baf-47b7-aea9-ef8204b5a670 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.318122 Aug 10 17:15:31.663436 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 93/171] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 17:15:31 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/os-interface => generated 284 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:15:32.349557 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-26d975a2-0d9b-4d4a-8657-14134763847e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:32.350441 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-26d975a2-0d9b-4d4a-8657-14134763847e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:32.362520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26d975a2-0d9b-4d4a-8657-14134763847e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:32.364804 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26d975a2-0d9b-4d4a-8657-14134763847e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:32.366319 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26d975a2-0d9b-4d4a-8657-14134763847e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:32.368314 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26d975a2-0d9b-4d4a-8657-14134763847e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:32.369818 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26d975a2-0d9b-4d4a-8657-14134763847e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:32.371690 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26d975a2-0d9b-4d4a-8657-14134763847e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:32.803602 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-4dfcfc3c-55bf-4dcf-8ca6-1ce9f933121c req-16b118fc-7dba-4701-bdb4-fb0d626ace7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e46673f-6139-4b97-b57a-b65886eb16b1", "tag": "65857e53-de9a-43a1-9362-2d62644ab14a"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:15:32.847041 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-4dfcfc3c-55bf-4dcf-8ca6-1ce9f933121c req-16b118fc-7dba-4701-bdb4-fb0d626ace7e service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:32.847635 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-4dfcfc3c-55bf-4dcf-8ca6-1ce9f933121c req-16b118fc-7dba-4701-bdb4-fb0d626ace7e service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:32.848313 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-4dfcfc3c-55bf-4dcf-8ca6-1ce9f933121c req-16b118fc-7dba-4701-bdb4-fb0d626ace7e service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:32.863015 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-4dfcfc3c-55bf-4dcf-8ca6-1ce9f933121c req-16b118fc-7dba-4701-bdb4-fb0d626ace7e service nova] Creating event network-changed:65857e53-de9a-43a1-9362-2d62644ab14a for instance 1e46673f-6139-4b97-b57a-b65886eb16b1 on hv-cinder-85272 Aug 10 17:15:32.870407 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-4dfcfc3c-55bf-4dcf-8ca6-1ce9f933121c req-16b118fc-7dba-4701-bdb4-fb0d626ace7e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070799 Aug 10 17:15:32.874768 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 94/172] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:15:32.912287 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-26d975a2-0d9b-4d4a-8657-14134763847e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:32.916167 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:32.926227 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-26d975a2-0d9b-4d4a-8657-14134763847e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.580395 Aug 10 17:15:32.928246 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 79/173] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:32 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:33.951963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-aae8d0fb-2037-4ae7-ba20-26ff9e9f6bb9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:33.953161 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-aae8d0fb-2037-4ae7-ba20-26ff9e9f6bb9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:33.969993 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aae8d0fb-2037-4ae7-ba20-26ff9e9f6bb9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:33.971693 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aae8d0fb-2037-4ae7-ba20-26ff9e9f6bb9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:33.973018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aae8d0fb-2037-4ae7-ba20-26ff9e9f6bb9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:33.977505 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aae8d0fb-2037-4ae7-ba20-26ff9e9f6bb9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:33.981001 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aae8d0fb-2037-4ae7-ba20-26ff9e9f6bb9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:33.982631 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aae8d0fb-2037-4ae7-ba20-26ff9e9f6bb9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:34.449205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-aae8d0fb-2037-4ae7-ba20-26ff9e9f6bb9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:34.457776 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-aae8d0fb-2037-4ae7-ba20-26ff9e9f6bb9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.512899 Aug 10 17:15:34.458433 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 95/174] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:33 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:34.890685 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-1d629fa0-52b3-4914-87cf-7f204d4e6e09 req-6ea9173c-facd-4312-b646-147872dc6ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffd37426-ce25-4561-91df-9058dc474b7d", "tag": "737c9bf5-5977-43d1-a5ab-0601f1af1149"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:15:34.913838 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-1d629fa0-52b3-4914-87cf-7f204d4e6e09 req-6ea9173c-facd-4312-b646-147872dc6ffc service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:34.914899 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-1d629fa0-52b3-4914-87cf-7f204d4e6e09 req-6ea9173c-facd-4312-b646-147872dc6ffc service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:34.916570 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-1d629fa0-52b3-4914-87cf-7f204d4e6e09 req-6ea9173c-facd-4312-b646-147872dc6ffc service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:34.950771 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-1d629fa0-52b3-4914-87cf-7f204d4e6e09 req-6ea9173c-facd-4312-b646-147872dc6ffc service nova] Creating event network-changed:737c9bf5-5977-43d1-a5ab-0601f1af1149 for instance ffd37426-ce25-4561-91df-9058dc474b7d on hv-cinder-85272 Aug 10 17:15:34.960668 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-1d629fa0-52b3-4914-87cf-7f204d4e6e09 req-6ea9173c-facd-4312-b646-147872dc6ffc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076042 Aug 10 17:15:34.963203 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 80/175] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:15:35.494281 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e96a71d8-447c-4bce-8952-0659be789538 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:35.498423 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e96a71d8-447c-4bce-8952-0659be789538 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:35.516500 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e96a71d8-447c-4bce-8952-0659be789538 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:35.517356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e96a71d8-447c-4bce-8952-0659be789538 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:35.518189 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e96a71d8-447c-4bce-8952-0659be789538 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:35.520887 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e96a71d8-447c-4bce-8952-0659be789538 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:35.522326 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e96a71d8-447c-4bce-8952-0659be789538 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:35.523151 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e96a71d8-447c-4bce-8952-0659be789538 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:35.981574 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e96a71d8-447c-4bce-8952-0659be789538 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:36.009495 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e96a71d8-447c-4bce-8952-0659be789538 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.532017 Aug 10 17:15:36.011644 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 96/176] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:35 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:37.059724 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1fd26a77-9913-457b-942d-66e24f9b38ab tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:37.060931 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1fd26a77-9913-457b-942d-66e24f9b38ab tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:37.076423 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1fd26a77-9913-457b-942d-66e24f9b38ab tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:37.077214 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1fd26a77-9913-457b-942d-66e24f9b38ab tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:37.077817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1fd26a77-9913-457b-942d-66e24f9b38ab tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:37.078737 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1fd26a77-9913-457b-942d-66e24f9b38ab tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:37.079563 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1fd26a77-9913-457b-942d-66e24f9b38ab tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:37.080543 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1fd26a77-9913-457b-942d-66e24f9b38ab tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:37.294869 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1fd26a77-9913-457b-942d-66e24f9b38ab tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:37.309681 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1fd26a77-9913-457b-942d-66e24f9b38ab tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.256874 Aug 10 17:15:37.310932 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 81/177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:37 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:38.334423 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-94196e4d-13ef-44be-9ca0-881819c60c69 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:38.335052 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-94196e4d-13ef-44be-9ca0-881819c60c69 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:38.348529 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94196e4d-13ef-44be-9ca0-881819c60c69 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:38.350041 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94196e4d-13ef-44be-9ca0-881819c60c69 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:38.350545 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94196e4d-13ef-44be-9ca0-881819c60c69 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:38.351295 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94196e4d-13ef-44be-9ca0-881819c60c69 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:38.351760 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94196e4d-13ef-44be-9ca0-881819c60c69 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:38.352193 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94196e4d-13ef-44be-9ca0-881819c60c69 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:38.521909 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-94196e4d-13ef-44be-9ca0-881819c60c69 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:38.532927 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-94196e4d-13ef-44be-9ca0-881819c60c69 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.203561 Aug 10 17:15:38.533526 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 97/178] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:38 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:39.560271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-555ab7b4-3080-47cc-b8e8-6bea226746c4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:39.562577 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-555ab7b4-3080-47cc-b8e8-6bea226746c4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:39.580996 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-555ab7b4-3080-47cc-b8e8-6bea226746c4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:39.582205 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-555ab7b4-3080-47cc-b8e8-6bea226746c4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:39.583154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-555ab7b4-3080-47cc-b8e8-6bea226746c4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:39.585097 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-555ab7b4-3080-47cc-b8e8-6bea226746c4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:39.585535 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-555ab7b4-3080-47cc-b8e8-6bea226746c4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:39.586397 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-555ab7b4-3080-47cc-b8e8-6bea226746c4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:39.780703 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-555ab7b4-3080-47cc-b8e8-6bea226746c4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:39.797207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-555ab7b4-3080-47cc-b8e8-6bea226746c4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.244695 Aug 10 17:15:39.798605 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 82/179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:39 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:39.883587 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ea7bece7-2441-4955-a019-44569793d0b7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:39.885892 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ea7bece7-2441-4955-a019-44569793d0b7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:39.893109 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea7bece7-2441-4955-a019-44569793d0b7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:39.893998 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea7bece7-2441-4955-a019-44569793d0b7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:39.894593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea7bece7-2441-4955-a019-44569793d0b7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:39.895621 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea7bece7-2441-4955-a019-44569793d0b7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:39.896253 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea7bece7-2441-4955-a019-44569793d0b7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:39.896981 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea7bece7-2441-4955-a019-44569793d0b7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:39.935763 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ea7bece7-2441-4955-a019-44569793d0b7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:15:40.315228 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ea7bece7-2441-4955-a019-44569793d0b7 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 204 len: 0 microversion: 2.1 time: 0.434214 Aug 10 17:15:40.319318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 98/180] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:15:39 2022] DELETE /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:15:40.336121 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-02547b62-9d3a-4b4a-83ce-8ebafe032a93 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:40.336957 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-02547b62-9d3a-4b4a-83ce-8ebafe032a93 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:40.350984 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02547b62-9d3a-4b4a-83ce-8ebafe032a93 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:40.351526 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02547b62-9d3a-4b4a-83ce-8ebafe032a93 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:40.351980 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02547b62-9d3a-4b4a-83ce-8ebafe032a93 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:40.353300 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02547b62-9d3a-4b4a-83ce-8ebafe032a93 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:40.353826 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02547b62-9d3a-4b4a-83ce-8ebafe032a93 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:40.354265 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02547b62-9d3a-4b4a-83ce-8ebafe032a93 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:40.565855 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-02547b62-9d3a-4b4a-83ce-8ebafe032a93 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:40.583021 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-02547b62-9d3a-4b4a-83ce-8ebafe032a93 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1552 microversion: 2.1 time: 0.257726 Aug 10 17:15:40.584258 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 83/181] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:40 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1552 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:40.835826 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9fae303a-f27b-40f4-8503-aabb6e6244e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:40.837669 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9fae303a-f27b-40f4-8503-aabb6e6244e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:40.863368 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fae303a-f27b-40f4-8503-aabb6e6244e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:40.863368 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fae303a-f27b-40f4-8503-aabb6e6244e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:40.863368 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fae303a-f27b-40f4-8503-aabb6e6244e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:40.863368 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fae303a-f27b-40f4-8503-aabb6e6244e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:40.863911 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fae303a-f27b-40f4-8503-aabb6e6244e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:40.863911 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fae303a-f27b-40f4-8503-aabb6e6244e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:41.022802 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9fae303a-f27b-40f4-8503-aabb6e6244e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:41.038017 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9fae303a-f27b-40f4-8503-aabb6e6244e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.208997 Aug 10 17:15:41.038898 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 99/182] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:40 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:41.621590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-57552f27-d579-42cd-a86a-0d18a16e5af6 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:41.622894 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-57552f27-d579-42cd-a86a-0d18a16e5af6 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:41.635193 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57552f27-d579-42cd-a86a-0d18a16e5af6 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:41.642470 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57552f27-d579-42cd-a86a-0d18a16e5af6 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:41.642470 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57552f27-d579-42cd-a86a-0d18a16e5af6 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:41.642470 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57552f27-d579-42cd-a86a-0d18a16e5af6 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:41.642470 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57552f27-d579-42cd-a86a-0d18a16e5af6 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:41.643148 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57552f27-d579-42cd-a86a-0d18a16e5af6 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:41.831411 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-57552f27-d579-42cd-a86a-0d18a16e5af6 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:41.843174 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-57552f27-d579-42cd-a86a-0d18a16e5af6 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1552 microversion: 2.1 time: 0.229707 Aug 10 17:15:41.843788 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 84/183] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:41 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1552 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:42.062752 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-33022bbf-8a8c-40a2-ab74-9be14348e2cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:42.063688 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-33022bbf-8a8c-40a2-ab74-9be14348e2cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:42.072270 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33022bbf-8a8c-40a2-ab74-9be14348e2cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:42.073319 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33022bbf-8a8c-40a2-ab74-9be14348e2cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:42.073885 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33022bbf-8a8c-40a2-ab74-9be14348e2cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:42.074668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33022bbf-8a8c-40a2-ab74-9be14348e2cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:42.075132 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33022bbf-8a8c-40a2-ab74-9be14348e2cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:42.076152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33022bbf-8a8c-40a2-ab74-9be14348e2cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:42.273670 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-33022bbf-8a8c-40a2-ab74-9be14348e2cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:42.282740 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-33022bbf-8a8c-40a2-ab74-9be14348e2cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.223985 Aug 10 17:15:42.283322 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 100/184] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:42 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:42.867426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-65ac9398-bf2d-4499-ab44-4931d660b692 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:42.868576 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-65ac9398-bf2d-4499-ab44-4931d660b692 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:42.885879 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65ac9398-bf2d-4499-ab44-4931d660b692 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:42.885879 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65ac9398-bf2d-4499-ab44-4931d660b692 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:42.885879 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65ac9398-bf2d-4499-ab44-4931d660b692 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:42.885879 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65ac9398-bf2d-4499-ab44-4931d660b692 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:42.886586 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65ac9398-bf2d-4499-ab44-4931d660b692 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:42.886586 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65ac9398-bf2d-4499-ab44-4931d660b692 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:43.051654 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-65ac9398-bf2d-4499-ab44-4931d660b692 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:43.070618 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-65ac9398-bf2d-4499-ab44-4931d660b692 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1552 microversion: 2.1 time: 0.206980 Aug 10 17:15:43.072053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 85/185] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:42 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1552 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:43.313875 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3e606fa4-7f38-46b3-a4d3-36916aa63fb4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:43.316043 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3e606fa4-7f38-46b3-a4d3-36916aa63fb4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:43.330897 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e606fa4-7f38-46b3-a4d3-36916aa63fb4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:43.331776 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e606fa4-7f38-46b3-a4d3-36916aa63fb4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:43.332591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e606fa4-7f38-46b3-a4d3-36916aa63fb4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:43.333820 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e606fa4-7f38-46b3-a4d3-36916aa63fb4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:43.335030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e606fa4-7f38-46b3-a4d3-36916aa63fb4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:43.336081 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e606fa4-7f38-46b3-a4d3-36916aa63fb4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:43.566143 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3e606fa4-7f38-46b3-a4d3-36916aa63fb4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:43.576991 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3e606fa4-7f38-46b3-a4d3-36916aa63fb4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.272804 Aug 10 17:15:43.577713 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 101/186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:43 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:44.095822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-53c6ce03-ee85-44a0-9a6d-5c3dc3c9a609 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:44.097316 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-53c6ce03-ee85-44a0-9a6d-5c3dc3c9a609 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:44.108914 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53c6ce03-ee85-44a0-9a6d-5c3dc3c9a609 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:44.109775 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53c6ce03-ee85-44a0-9a6d-5c3dc3c9a609 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:44.110617 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53c6ce03-ee85-44a0-9a6d-5c3dc3c9a609 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:44.111888 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53c6ce03-ee85-44a0-9a6d-5c3dc3c9a609 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:44.113759 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53c6ce03-ee85-44a0-9a6d-5c3dc3c9a609 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:44.114229 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53c6ce03-ee85-44a0-9a6d-5c3dc3c9a609 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:44.208654 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-53c6ce03-ee85-44a0-9a6d-5c3dc3c9a609 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:44.219808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-53c6ce03-ee85-44a0-9a6d-5c3dc3c9a609 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1510 microversion: 2.1 time: 0.129418 Aug 10 17:15:44.220395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 86/187] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:44 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1510 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:44.254532 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-ca8a7f93-5ee6-40fd-bf97-58c82a07adcf req-4b1b9c26-8ebc-49a3-acaa-0315b554da73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5e24ad-a791-4465-be5f-0b99c26f2655", "name": "network-vif-deleted", "tag": "e9bdd79f-d6e0-4ff0-a545-38e482ce16a2"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:15:44.265525 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ca8a7f93-5ee6-40fd-bf97-58c82a07adcf req-4b1b9c26-8ebc-49a3-acaa-0315b554da73 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:44.266449 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ca8a7f93-5ee6-40fd-bf97-58c82a07adcf req-4b1b9c26-8ebc-49a3-acaa-0315b554da73 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:44.266900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ca8a7f93-5ee6-40fd-bf97-58c82a07adcf req-4b1b9c26-8ebc-49a3-acaa-0315b554da73 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:44.281075 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-ca8a7f93-5ee6-40fd-bf97-58c82a07adcf req-4b1b9c26-8ebc-49a3-acaa-0315b554da73 service nova] Creating event network-vif-deleted:e9bdd79f-d6e0-4ff0-a545-38e482ce16a2 for instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 on hv-cinder-85272 Aug 10 17:15:44.286840 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-ca8a7f93-5ee6-40fd-bf97-58c82a07adcf req-4b1b9c26-8ebc-49a3-acaa-0315b554da73 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036135 Aug 10 17:15:44.287803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 102/188] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:15:44.601193 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6165ed71-7326-4b32-bccd-40072b226f88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:44.601984 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6165ed71-7326-4b32-bccd-40072b226f88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:44.610958 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6165ed71-7326-4b32-bccd-40072b226f88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:44.611805 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6165ed71-7326-4b32-bccd-40072b226f88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:44.611914 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6165ed71-7326-4b32-bccd-40072b226f88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:44.612984 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6165ed71-7326-4b32-bccd-40072b226f88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:44.613659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6165ed71-7326-4b32-bccd-40072b226f88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:44.614387 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6165ed71-7326-4b32-bccd-40072b226f88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:44.758063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6165ed71-7326-4b32-bccd-40072b226f88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:44.767819 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6165ed71-7326-4b32-bccd-40072b226f88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.172018 Aug 10 17:15:44.768451 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 87/189] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:44 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:45.245578 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bedb7b1e-52c6-43a0-9ac6-65dc3560deeb tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:45.246608 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bedb7b1e-52c6-43a0-9ac6-65dc3560deeb tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:45.254166 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bedb7b1e-52c6-43a0-9ac6-65dc3560deeb tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:45.254777 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bedb7b1e-52c6-43a0-9ac6-65dc3560deeb tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:45.255279 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bedb7b1e-52c6-43a0-9ac6-65dc3560deeb tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:45.256196 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bedb7b1e-52c6-43a0-9ac6-65dc3560deeb tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:45.256897 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bedb7b1e-52c6-43a0-9ac6-65dc3560deeb tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:45.257541 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bedb7b1e-52c6-43a0-9ac6-65dc3560deeb tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:45.327985 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bedb7b1e-52c6-43a0-9ac6-65dc3560deeb tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:45.339138 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bedb7b1e-52c6-43a0-9ac6-65dc3560deeb tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1510 microversion: 2.1 time: 0.099047 Aug 10 17:15:45.339894 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 103/190] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:45 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1510 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:45.788748 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e1b3c086-a50b-4ff7-b73f-c7f45340fd2a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:45.789423 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e1b3c086-a50b-4ff7-b73f-c7f45340fd2a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:45.796858 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1b3c086-a50b-4ff7-b73f-c7f45340fd2a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:45.797380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1b3c086-a50b-4ff7-b73f-c7f45340fd2a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:45.797803 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1b3c086-a50b-4ff7-b73f-c7f45340fd2a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:45.798577 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1b3c086-a50b-4ff7-b73f-c7f45340fd2a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:45.799041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1b3c086-a50b-4ff7-b73f-c7f45340fd2a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:45.799472 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1b3c086-a50b-4ff7-b73f-c7f45340fd2a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:45.953288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e1b3c086-a50b-4ff7-b73f-c7f45340fd2a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:45.963739 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e1b3c086-a50b-4ff7-b73f-c7f45340fd2a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.178366 Aug 10 17:15:45.964363 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 88/191] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:45 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:46.364992 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cb6eb4a6-34f5-4841-be6a-3c7779498494 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:46.366119 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cb6eb4a6-34f5-4841-be6a-3c7779498494 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:46.375395 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb6eb4a6-34f5-4841-be6a-3c7779498494 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:46.376057 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb6eb4a6-34f5-4841-be6a-3c7779498494 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:46.376599 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb6eb4a6-34f5-4841-be6a-3c7779498494 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:46.377515 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb6eb4a6-34f5-4841-be6a-3c7779498494 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:46.378068 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb6eb4a6-34f5-4841-be6a-3c7779498494 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:46.378644 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb6eb4a6-34f5-4841-be6a-3c7779498494 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:46.451107 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cb6eb4a6-34f5-4841-be6a-3c7779498494 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:46.459935 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cb6eb4a6-34f5-4841-be6a-3c7779498494 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1510 microversion: 2.1 time: 0.102621 Aug 10 17:15:46.474646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 104/192] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:46 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1510 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:46.985270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c2a98ab9-4981-4675-98f5-bec5a8e9baa0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:46.985886 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c2a98ab9-4981-4675-98f5-bec5a8e9baa0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:46.992663 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c2a98ab9-4981-4675-98f5-bec5a8e9baa0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:46.993359 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c2a98ab9-4981-4675-98f5-bec5a8e9baa0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:46.993603 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c2a98ab9-4981-4675-98f5-bec5a8e9baa0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:46.994345 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c2a98ab9-4981-4675-98f5-bec5a8e9baa0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:46.994824 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c2a98ab9-4981-4675-98f5-bec5a8e9baa0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:46.995255 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c2a98ab9-4981-4675-98f5-bec5a8e9baa0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:47.142507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c2a98ab9-4981-4675-98f5-bec5a8e9baa0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:47.150261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c2a98ab9-4981-4675-98f5-bec5a8e9baa0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.168974 Aug 10 17:15:47.150878 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 89/193] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:46 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:47.485857 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b3a9040e-be87-45af-9335-cf21eb9d9196 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:47.488083 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b3a9040e-be87-45af-9335-cf21eb9d9196 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:47.491698 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:47.501039 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3a9040e-be87-45af-9335-cf21eb9d9196 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:47.501933 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3a9040e-be87-45af-9335-cf21eb9d9196 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:47.502773 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3a9040e-be87-45af-9335-cf21eb9d9196 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:47.504313 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3a9040e-be87-45af-9335-cf21eb9d9196 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:47.505418 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3a9040e-be87-45af-9335-cf21eb9d9196 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:47.506456 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3a9040e-be87-45af-9335-cf21eb9d9196 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:47.645443 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b3a9040e-be87-45af-9335-cf21eb9d9196 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:47.660268 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b3a9040e-be87-45af-9335-cf21eb9d9196 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1345 microversion: 2.1 time: 0.181233 Aug 10 17:15:47.661255 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 105/194] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:47 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1345 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:48.176308 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d7fe9ee0-80de-4acb-817f-5c753d0683ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:48.177332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d7fe9ee0-80de-4acb-817f-5c753d0683ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:48.188914 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d7fe9ee0-80de-4acb-817f-5c753d0683ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:48.189789 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d7fe9ee0-80de-4acb-817f-5c753d0683ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:48.190528 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d7fe9ee0-80de-4acb-817f-5c753d0683ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:48.191292 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d7fe9ee0-80de-4acb-817f-5c753d0683ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:48.191785 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d7fe9ee0-80de-4acb-817f-5c753d0683ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:48.192268 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d7fe9ee0-80de-4acb-817f-5c753d0683ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:48.440109 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d7fe9ee0-80de-4acb-817f-5c753d0683ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:48.455466 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d7fe9ee0-80de-4acb-817f-5c753d0683ce tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.286105 Aug 10 17:15:48.457318 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 90/195] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:48 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:48.699844 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d9c0cd44-b56e-45d3-b098-44f11281ce88 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:48.700846 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d9c0cd44-b56e-45d3-b098-44f11281ce88 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:48.711205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9c0cd44-b56e-45d3-b098-44f11281ce88 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:48.712645 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9c0cd44-b56e-45d3-b098-44f11281ce88 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:48.724591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9c0cd44-b56e-45d3-b098-44f11281ce88 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:48.725455 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9c0cd44-b56e-45d3-b098-44f11281ce88 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:48.725953 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9c0cd44-b56e-45d3-b098-44f11281ce88 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:48.726493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9c0cd44-b56e-45d3-b098-44f11281ce88 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:48.763614 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9c0cd44-b56e-45d3-b098-44f11281ce88 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:48.764114 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9c0cd44-b56e-45d3-b098-44f11281ce88 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:48.764602 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9c0cd44-b56e-45d3-b098-44f11281ce88 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:48.765245 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-d9c0cd44-b56e-45d3-b098-44f11281ce88 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lazy-loading 'fault' on Instance uuid 7d5e24ad-a791-4465-be5f-0b99c26f2655 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:15:48.818311 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d9c0cd44-b56e-45d3-b098-44f11281ce88 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cb7a8f70ab409b86c669620df4a651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7cd3e7d80845e89b398f0707097ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:48.820739 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:48.831448 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d9c0cd44-b56e-45d3-b098-44f11281ce88 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 200 len: 1350 microversion: 2.1 time: 0.139782 Aug 10 17:15:48.834211 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 106/196] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:48 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 1350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:49.491277 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d937b96c-0c9c-453e-a8b3-0f8672a086e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:49.492031 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d937b96c-0c9c-453e-a8b3-0f8672a086e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:49.503472 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d937b96c-0c9c-453e-a8b3-0f8672a086e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:49.504812 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d937b96c-0c9c-453e-a8b3-0f8672a086e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:49.505484 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d937b96c-0c9c-453e-a8b3-0f8672a086e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:49.506780 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d937b96c-0c9c-453e-a8b3-0f8672a086e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:49.507584 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d937b96c-0c9c-453e-a8b3-0f8672a086e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:49.508359 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d937b96c-0c9c-453e-a8b3-0f8672a086e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:49.702012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d937b96c-0c9c-453e-a8b3-0f8672a086e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:49.710182 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d937b96c-0c9c-453e-a8b3-0f8672a086e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.222882 Aug 10 17:15:49.710833 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 91/197] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:49 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:49.872063 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d620cf7a-dfc5-4be7-b277-94166d0afb4c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:49.873055 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d620cf7a-dfc5-4be7-b277-94166d0afb4c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:49.880078 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d620cf7a-dfc5-4be7-b277-94166d0afb4c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:49.880570 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d620cf7a-dfc5-4be7-b277-94166d0afb4c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:49.881018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d620cf7a-dfc5-4be7-b277-94166d0afb4c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:49.881739 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d620cf7a-dfc5-4be7-b277-94166d0afb4c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:49.882195 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d620cf7a-dfc5-4be7-b277-94166d0afb4c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:49.882658 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d620cf7a-dfc5-4be7-b277-94166d0afb4c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:49.898213 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-d620cf7a-dfc5-4be7-b277-94166d0afb4c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] HTTP exception thrown: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d620cf7a-dfc5-4be7-b277-94166d0afb4c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Request method failure captured: Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 HTTP/1.1 Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-dyc5KuhA-cp8hGUVmUGzlIc-hLJynawFjwjmi6vNM3GXK8Qdt4AMAON39mTkggOwG6yKZ2Z_T2SNv_L3QYCLyl3GueHv8BleSI1XmpoTn3FPbJW5KbLtUfrvm7Ac_LirAw4rSuyHfeIS_K78qHmDcnzBVJuXoA_dWGWcyXFGSDjes Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: 8a7cd3e7d80845e89b398f0707097ffd Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-DeleteServersTestJSON-2022002016 Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:15:49.904126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:15:49.905683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a7cd3e7d80845e89b398f0707097ffd", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a7cd3e7d80845e89b398f0707097ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a7cd3e7d80845e89b398f0707097ffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a7cd3e7d80845e89b398f0707097ffd"}]}] Aug 10 17:15:49.905683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-DeleteServersTestJSON-2022002016 Aug 10 17:15:49.905683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 8a7cd3e7d80845e89b398f0707097ffd Aug 10 17:15:49.905683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-DeleteServersTestJSON-2022002016 Aug 10 17:15:49.905683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-DeleteServersTestJSON-2022002016-project Aug 10 17:15:49.905683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:15:49.905683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:15:49.905683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 06cb7a8f70ab409b86c669620df4a651 Aug 10 17:15:49.905683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-DeleteServersTestJSON-2022002016-project Aug 10 17:15:49.905683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:15:49.905683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:49.905683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': '7d5e24ad-a791-4465-be5f-0b99c26f2655'} Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:15:49.906629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:49.908030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:15:49.909212 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d620cf7a-dfc5-4be7-b277-94166d0afb4c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Returning 404 to user: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:15:49.909212 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d620cf7a-dfc5-4be7-b277-94166d0afb4c tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 404 len: 111 microversion: 2.1 time: 0.037603 Aug 10 17:15:49.909212 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 107/198] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:49 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:15:50.090497 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-24f3ca0a-329b-4365-8b7a-b9f5b7325224 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:50.093149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-24f3ca0a-329b-4365-8b7a-b9f5b7325224 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:50.099872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24f3ca0a-329b-4365-8b7a-b9f5b7325224 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:50.100396 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24f3ca0a-329b-4365-8b7a-b9f5b7325224 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:50.100851 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24f3ca0a-329b-4365-8b7a-b9f5b7325224 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:50.101583 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24f3ca0a-329b-4365-8b7a-b9f5b7325224 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:50.102210 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24f3ca0a-329b-4365-8b7a-b9f5b7325224 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:50.102688 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24f3ca0a-329b-4365-8b7a-b9f5b7325224 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:50.122380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-24f3ca0a-329b-4365-8b7a-b9f5b7325224 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] HTTP exception thrown: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-24f3ca0a-329b-4365-8b7a-b9f5b7325224 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Request method failure captured: Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655/os-volume_attachments HTTP/1.1 Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-dyc5KuhA-cp8hGUVmUGzlIc-hLJynawFjwjmi6vNM3GXK8Qdt4AMAON39mTkggOwG6yKZ2Z_T2SNv_L3QYCLyl3GueHv8BleSI1XmpoTn3FPbJW5KbLtUfrvm7Ac_LirAw4rSuyHfeIS_K78qHmDcnzBVJuXoA_dWGWcyXFGSDjes Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: 8a7cd3e7d80845e89b398f0707097ffd Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-DeleteServersTestJSON-2022002016 Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:15:50.126817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:15:50.129401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a7cd3e7d80845e89b398f0707097ffd", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a7cd3e7d80845e89b398f0707097ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a7cd3e7d80845e89b398f0707097ffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a7cd3e7d80845e89b398f0707097ffd"}]}] Aug 10 17:15:50.129401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-DeleteServersTestJSON-2022002016 Aug 10 17:15:50.129401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 8a7cd3e7d80845e89b398f0707097ffd Aug 10 17:15:50.129401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-DeleteServersTestJSON-2022002016 Aug 10 17:15:50.129401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-DeleteServersTestJSON-2022002016-project Aug 10 17:15:50.129401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:15:50.129401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:15:50.129401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 06cb7a8f70ab409b86c669620df4a651 Aug 10 17:15:50.129401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-DeleteServersTestJSON-2022002016-project Aug 10 17:15:50.129401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:15:50.129401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:50.129401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'server_id': '7d5e24ad-a791-4465-be5f-0b99c26f2655'} Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:15:50.130202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:50.131712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:15:50.133212 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-24f3ca0a-329b-4365-8b7a-b9f5b7325224 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Returning 404 to user: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:15:50.133212 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-24f3ca0a-329b-4365-8b7a-b9f5b7325224 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042579 Aug 10 17:15:50.133212 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 92/199] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:15:50 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:15:50.736841 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3b853615-537e-4d3a-a423-e374238cc4ac tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:50.737868 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3b853615-537e-4d3a-a423-e374238cc4ac tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:50.748577 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b853615-537e-4d3a-a423-e374238cc4ac tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:50.749073 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b853615-537e-4d3a-a423-e374238cc4ac tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:50.749720 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b853615-537e-4d3a-a423-e374238cc4ac tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:50.750390 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b853615-537e-4d3a-a423-e374238cc4ac tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:50.751030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b853615-537e-4d3a-a423-e374238cc4ac tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:50.751460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b853615-537e-4d3a-a423-e374238cc4ac tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:50.904080 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3b853615-537e-4d3a-a423-e374238cc4ac tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:50.913349 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3b853615-537e-4d3a-a423-e374238cc4ac tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.182268 Aug 10 17:15:50.914087 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 108/200] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:50 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:51.573207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3b128ece-ae7f-4d09-bd03-12705fdf0172 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:51.574257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3b128ece-ae7f-4d09-bd03-12705fdf0172 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:51.587275 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b128ece-ae7f-4d09-bd03-12705fdf0172 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:51.588746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b128ece-ae7f-4d09-bd03-12705fdf0172 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:51.589672 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b128ece-ae7f-4d09-bd03-12705fdf0172 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:51.591276 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b128ece-ae7f-4d09-bd03-12705fdf0172 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:51.592339 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b128ece-ae7f-4d09-bd03-12705fdf0172 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:51.593136 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b128ece-ae7f-4d09-bd03-12705fdf0172 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:51.623936 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-3b128ece-ae7f-4d09-bd03-12705fdf0172 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] HTTP exception thrown: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3b128ece-ae7f-4d09-bd03-12705fdf0172 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Request method failure captured: Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 HTTP/1.1 Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-dyc5KuhA-cp8hGUVmUGzlIc-hLJynawFjwjmi6vNM3GXK8Qdt4AMAON39mTkggOwG6yKZ2Z_T2SNv_L3QYCLyl3GueHv8BleSI1XmpoTn3FPbJW5KbLtUfrvm7Ac_LirAw4rSuyHfeIS_K78qHmDcnzBVJuXoA_dWGWcyXFGSDjes Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: 8a7cd3e7d80845e89b398f0707097ffd Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-DeleteServersTestJSON-2022002016 Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:15:51.628064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:15:51.635694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a7cd3e7d80845e89b398f0707097ffd", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a7cd3e7d80845e89b398f0707097ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a7cd3e7d80845e89b398f0707097ffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a7cd3e7d80845e89b398f0707097ffd"}]}] Aug 10 17:15:51.635694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-DeleteServersTestJSON-2022002016 Aug 10 17:15:51.635694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 8a7cd3e7d80845e89b398f0707097ffd Aug 10 17:15:51.635694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-DeleteServersTestJSON-2022002016 Aug 10 17:15:51.635694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-DeleteServersTestJSON-2022002016-project Aug 10 17:15:51.635694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:15:51.635694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:15:51.635694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 06cb7a8f70ab409b86c669620df4a651 Aug 10 17:15:51.635694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-DeleteServersTestJSON-2022002016-project Aug 10 17:15:51.635694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:15:51.635694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:51.635694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': '7d5e24ad-a791-4465-be5f-0b99c26f2655'} Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:15:51.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:51.638188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:15:51.639612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3b128ece-ae7f-4d09-bd03-12705fdf0172 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Returning 404 to user: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:15:51.639612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3b128ece-ae7f-4d09-bd03-12705fdf0172 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 404 len: 111 microversion: 2.1 time: 0.065027 Aug 10 17:15:51.639612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 93/201] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:15:51 2022] DELETE /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:15:51.649003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a6a8f83b-8b4c-47ad-9454-8c4c130118a4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:51.650665 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a6a8f83b-8b4c-47ad-9454-8c4c130118a4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] [instance: 7d5e24ad-a791-4465-be5f-0b99c26f2655] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:51.661414 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6a8f83b-8b4c-47ad-9454-8c4c130118a4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:51.662318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6a8f83b-8b4c-47ad-9454-8c4c130118a4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:51.663139 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6a8f83b-8b4c-47ad-9454-8c4c130118a4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:51.664397 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6a8f83b-8b4c-47ad-9454-8c4c130118a4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:51.665295 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6a8f83b-8b4c-47ad-9454-8c4c130118a4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:51.666062 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6a8f83b-8b4c-47ad-9454-8c4c130118a4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:51.694220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-a6a8f83b-8b4c-47ad-9454-8c4c130118a4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] HTTP exception thrown: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a6a8f83b-8b4c-47ad-9454-8c4c130118a4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Request method failure captured: Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 HTTP/1.1 Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-dyc5KuhA-cp8hGUVmUGzlIc-hLJynawFjwjmi6vNM3GXK8Qdt4AMAON39mTkggOwG6yKZ2Z_T2SNv_L3QYCLyl3GueHv8BleSI1XmpoTn3FPbJW5KbLtUfrvm7Ac_LirAw4rSuyHfeIS_K78qHmDcnzBVJuXoA_dWGWcyXFGSDjes Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: 8a7cd3e7d80845e89b398f0707097ffd Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-DeleteServersTestJSON-2022002016 Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:15:51.696859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:15:51.700003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a7cd3e7d80845e89b398f0707097ffd", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a7cd3e7d80845e89b398f0707097ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a7cd3e7d80845e89b398f0707097ffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a7cd3e7d80845e89b398f0707097ffd"}]}] Aug 10 17:15:51.700003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-DeleteServersTestJSON-2022002016 Aug 10 17:15:51.700003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 8a7cd3e7d80845e89b398f0707097ffd Aug 10 17:15:51.700003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-DeleteServersTestJSON-2022002016 Aug 10 17:15:51.700003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-DeleteServersTestJSON-2022002016-project Aug 10 17:15:51.700003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:15:51.700003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:15:51.700003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 06cb7a8f70ab409b86c669620df4a651 Aug 10 17:15:51.700003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-DeleteServersTestJSON-2022002016-project Aug 10 17:15:51.700003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:15:51.700003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:51.700003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': '7d5e24ad-a791-4465-be5f-0b99c26f2655'} Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:15:51.701492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. Aug 10 17:15:51.703799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:15:51.705931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a6a8f83b-8b4c-47ad-9454-8c4c130118a4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] Returning 404 to user: Instance 7d5e24ad-a791-4465-be5f-0b99c26f2655 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:15:51.705931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a6a8f83b-8b4c-47ad-9454-8c4c130118a4 tempest-DeleteServersTestJSON-2022002016 tempest-DeleteServersTestJSON-2022002016-project] 10.222.0.45 "GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655" status: 404 len: 111 microversion: 2.1 time: 0.057660 Aug 10 17:15:51.706766 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 109/202] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:51 2022] GET /compute/v2.1/servers/7d5e24ad-a791-4465-be5f-0b99c26f2655 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:15:51.936033 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2c6eed48-cfe4-4b74-87a9-c304f18a1a36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:51.936839 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2c6eed48-cfe4-4b74-87a9-c304f18a1a36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:51.940671 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=48 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:51.945468 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2c6eed48-cfe4-4b74-87a9-c304f18a1a36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:51.945986 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2c6eed48-cfe4-4b74-87a9-c304f18a1a36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:51.946861 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2c6eed48-cfe4-4b74-87a9-c304f18a1a36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:51.947675 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2c6eed48-cfe4-4b74-87a9-c304f18a1a36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:51.948221 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2c6eed48-cfe4-4b74-87a9-c304f18a1a36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:51.948830 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2c6eed48-cfe4-4b74-87a9-c304f18a1a36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:52.185432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2c6eed48-cfe4-4b74-87a9-c304f18a1a36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:52.194279 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2c6eed48-cfe4-4b74-87a9-c304f18a1a36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.262280 Aug 10 17:15:52.194808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 94/203] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:51 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:53.224188 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c3fea656-ef92-46c6-b7b5-a65a18a20b36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:53.226616 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c3fea656-ef92-46c6-b7b5-a65a18a20b36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:53.239224 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3fea656-ef92-46c6-b7b5-a65a18a20b36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:53.240185 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3fea656-ef92-46c6-b7b5-a65a18a20b36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:53.240943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3fea656-ef92-46c6-b7b5-a65a18a20b36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:53.242289 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3fea656-ef92-46c6-b7b5-a65a18a20b36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:53.243755 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3fea656-ef92-46c6-b7b5-a65a18a20b36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:53.244826 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3fea656-ef92-46c6-b7b5-a65a18a20b36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:53.458198 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c3fea656-ef92-46c6-b7b5-a65a18a20b36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:53.468339 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c3fea656-ef92-46c6-b7b5-a65a18a20b36 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.255322 Aug 10 17:15:53.469066 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 110/204] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:53 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:54.502260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-845b7dae-fa65-4555-8f4e-12a625ef310c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:54.504807 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-845b7dae-fa65-4555-8f4e-12a625ef310c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:54.515237 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-845b7dae-fa65-4555-8f4e-12a625ef310c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:54.516667 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-845b7dae-fa65-4555-8f4e-12a625ef310c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:54.517609 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-845b7dae-fa65-4555-8f4e-12a625ef310c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:54.518654 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-845b7dae-fa65-4555-8f4e-12a625ef310c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:54.519360 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-845b7dae-fa65-4555-8f4e-12a625ef310c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:54.520034 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-845b7dae-fa65-4555-8f4e-12a625ef310c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:54.931555 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-845b7dae-fa65-4555-8f4e-12a625ef310c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:54.942681 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-845b7dae-fa65-4555-8f4e-12a625ef310c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.446510 Aug 10 17:15:54.943634 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 95/205] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:54 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:15:55.974297 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-374aac6c-0b99-404e-adbb-cd449dbd779a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:55.975084 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-374aac6c-0b99-404e-adbb-cd449dbd779a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:55.991902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-374aac6c-0b99-404e-adbb-cd449dbd779a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:55.991902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-374aac6c-0b99-404e-adbb-cd449dbd779a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:55.991902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-374aac6c-0b99-404e-adbb-cd449dbd779a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:55.991902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-374aac6c-0b99-404e-adbb-cd449dbd779a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:55.992554 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-374aac6c-0b99-404e-adbb-cd449dbd779a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:55.992554 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-374aac6c-0b99-404e-adbb-cd449dbd779a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:56.648485 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-374aac6c-0b99-404e-adbb-cd449dbd779a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:56.659725 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-374aac6c-0b99-404e-adbb-cd449dbd779a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.690962 Aug 10 17:15:56.660684 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 111/206] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:55 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:57.689535 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cf80cba6-96b6-4207-958c-7573951b8813 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:57.690137 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cf80cba6-96b6-4207-958c-7573951b8813 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:57.697888 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cf80cba6-96b6-4207-958c-7573951b8813 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:57.698736 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cf80cba6-96b6-4207-958c-7573951b8813 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:57.699920 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cf80cba6-96b6-4207-958c-7573951b8813 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:57.700841 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cf80cba6-96b6-4207-958c-7573951b8813 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:57.701323 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cf80cba6-96b6-4207-958c-7573951b8813 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:57.701758 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cf80cba6-96b6-4207-958c-7573951b8813 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:57.936357 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cf80cba6-96b6-4207-958c-7573951b8813 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:57.945608 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cf80cba6-96b6-4207-958c-7573951b8813 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.260141 Aug 10 17:15:57.946968 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 96/207] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:57 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:15:58.971043 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a320d02a-9628-430c-9d6d-572efb41dfb6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:15:58.975943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a320d02a-9628-430c-9d6d-572efb41dfb6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:15:58.985032 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a320d02a-9628-430c-9d6d-572efb41dfb6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:58.986024 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a320d02a-9628-430c-9d6d-572efb41dfb6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:58.986720 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a320d02a-9628-430c-9d6d-572efb41dfb6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:58.987803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a320d02a-9628-430c-9d6d-572efb41dfb6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:15:58.988541 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a320d02a-9628-430c-9d6d-572efb41dfb6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:15:58.989248 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a320d02a-9628-430c-9d6d-572efb41dfb6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:15:59.204776 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a320d02a-9628-430c-9d6d-572efb41dfb6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:15:59.213626 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a320d02a-9628-430c-9d6d-572efb41dfb6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.249027 Aug 10 17:15:59.214298 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 112/208] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:15:58 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:00.247649 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-339d77d5-063a-486c-b0b9-afcfdc197127 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:00.247649 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-339d77d5-063a-486c-b0b9-afcfdc197127 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:00.257213 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-339d77d5-063a-486c-b0b9-afcfdc197127 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:00.258016 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-339d77d5-063a-486c-b0b9-afcfdc197127 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:00.259974 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-339d77d5-063a-486c-b0b9-afcfdc197127 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:00.261173 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-339d77d5-063a-486c-b0b9-afcfdc197127 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:00.262232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-339d77d5-063a-486c-b0b9-afcfdc197127 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:00.262970 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-339d77d5-063a-486c-b0b9-afcfdc197127 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:00.549142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-339d77d5-063a-486c-b0b9-afcfdc197127 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:00.573195 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-339d77d5-063a-486c-b0b9-afcfdc197127 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.336238 Aug 10 17:16:00.579757 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 97/209] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:00 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:01.608311 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0a587dcf-b20e-4a2e-9fa1-f107b4febdd6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:01.608311 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0a587dcf-b20e-4a2e-9fa1-f107b4febdd6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:01.620055 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a587dcf-b20e-4a2e-9fa1-f107b4febdd6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:01.621017 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a587dcf-b20e-4a2e-9fa1-f107b4febdd6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:01.623748 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a587dcf-b20e-4a2e-9fa1-f107b4febdd6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:01.625334 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a587dcf-b20e-4a2e-9fa1-f107b4febdd6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:01.626162 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a587dcf-b20e-4a2e-9fa1-f107b4febdd6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:01.626967 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a587dcf-b20e-4a2e-9fa1-f107b4febdd6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:01.630142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9336a115-97a6-4816-8f23-8aca9c0c4696 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Action: 'create', calling method: .version_select at 0x7f7eba262700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1782467554"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:01.673692 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:01.856402 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0a587dcf-b20e-4a2e-9fa1-f107b4febdd6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:01.863064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0a587dcf-b20e-4a2e-9fa1-f107b4febdd6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.264943 Aug 10 17:16:01.863649 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 98/210] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:01 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:02.576220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9336a115-97a6-4816-8f23-8aca9c0c4696 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.136576 Aug 10 17:16:02.577069 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 113/211] 10.222.0.45 () {60 vars in 1155 bytes} [Wed Aug 10 17:16:01 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1138 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 17:16:02.594641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-42fcadd2-fec6-4757-95a9-4f0910dbd0c2 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba248dc0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:02.718752 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-42fcadd2-fec6-4757-95a9-4f0910dbd0c2 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb" status: 200 len: 345 microversion: 2.1 time: 0.131087 Aug 10 17:16:02.731673 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 99/212] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:16:02 2022] GET /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:02.891306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-33b486be-e6a1-41d2-8358-b17a954ce803 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:02.891306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-33b486be-e6a1-41d2-8358-b17a954ce803 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:02.894032 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33b486be-e6a1-41d2-8358-b17a954ce803 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:02.894595 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33b486be-e6a1-41d2-8358-b17a954ce803 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:02.895043 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33b486be-e6a1-41d2-8358-b17a954ce803 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:02.895906 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33b486be-e6a1-41d2-8358-b17a954ce803 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:02.896206 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33b486be-e6a1-41d2-8358-b17a954ce803 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:02.896632 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33b486be-e6a1-41d2-8358-b17a954ce803 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:03.097119 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-33b486be-e6a1-41d2-8358-b17a954ce803 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:03.106903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-33b486be-e6a1-41d2-8358-b17a954ce803 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.225570 Aug 10 17:16:03.107648 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 114/213] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:02 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:03.739354 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-54d815f5-355b-41dc-aad7-a026eb254bc9 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba12c1f0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:03.791906 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-54d815f5-355b-41dc-aad7-a026eb254bc9 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb" status: 200 len: 345 microversion: 2.1 time: 0.055879 Aug 10 17:16:03.791906 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 100/214] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:16:03 2022] GET /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:16:04.130953 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-62705ab1-4c55-4309-837d-7d24c377be8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:04.131602 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-62705ab1-4c55-4309-837d-7d24c377be8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:04.138421 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62705ab1-4c55-4309-837d-7d24c377be8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:04.142092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62705ab1-4c55-4309-837d-7d24c377be8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:04.142092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62705ab1-4c55-4309-837d-7d24c377be8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:04.142092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62705ab1-4c55-4309-837d-7d24c377be8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:04.142092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62705ab1-4c55-4309-837d-7d24c377be8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:04.142583 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62705ab1-4c55-4309-837d-7d24c377be8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:04.282991 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-62705ab1-4c55-4309-837d-7d24c377be8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:04.292206 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-62705ab1-4c55-4309-837d-7d24c377be8d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.165018 Aug 10 17:16:04.292799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 115/215] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:04 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:04.811649 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-aea14190-9421-4128-99f7-e3bdcb6b2fdf tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba12e550>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:04.879400 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-aea14190-9421-4128-99f7-e3bdcb6b2fdf tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb" status: 200 len: 346 microversion: 2.1 time: 0.071978 Aug 10 17:16:04.880701 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 101/216] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:16:04 2022] GET /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:04.903215 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-739638a3-5bbf-4386-8ebb-5302b46e2588 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Action: 'create', calling method: .version_select at 0x7f7eba113ca0>, body: {"snapshot": {"volume_id": "6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1458816460"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:05.315065 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8b512110-5d8b-4984-a4dd-6558f840c97f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:05.315679 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8b512110-5d8b-4984-a4dd-6558f840c97f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:05.322198 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b512110-5d8b-4984-a4dd-6558f840c97f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:05.322723 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b512110-5d8b-4984-a4dd-6558f840c97f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:05.323160 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b512110-5d8b-4984-a4dd-6558f840c97f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:05.323867 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b512110-5d8b-4984-a4dd-6558f840c97f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:05.324322 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b512110-5d8b-4984-a4dd-6558f840c97f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:05.324786 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b512110-5d8b-4984-a4dd-6558f840c97f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:05.403076 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-739638a3-5bbf-4386-8ebb-5302b46e2588 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.506773 Aug 10 17:16:05.404622 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 116/217] 10.222.0.45 () {60 vars in 1162 bytes} [Wed Aug 10 17:16:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:05.415738 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e57f9674-6e30-4f8c-9256-0726c316197a tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba20b3a0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:05.457162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e57f9674-6e30-4f8c-9256-0726c316197a tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e" status: 200 len: 287 microversion: 2.1 time: 0.045309 Aug 10 17:16:05.457764 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 117/218] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 17:16:05 2022] GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:16:05.474326 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2d536947-511e-457a-a277-aebf70caf8d5 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7ebbe4fdc0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:05.500656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8b512110-5d8b-4984-a4dd-6558f840c97f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:05.510331 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8b512110-5d8b-4984-a4dd-6558f840c97f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.199118 Aug 10 17:16:05.511055 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 102/219] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:05 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:05.526640 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2d536947-511e-457a-a277-aebf70caf8d5 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.059017 Aug 10 17:16:05.527217 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 118/220] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Aug 10 17:16:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:05.538104 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4ef8c5e3-27aa-45a4-83b8-4b68115e897f tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba24d820>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:05.568496 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4ef8c5e3-27aa-45a4-83b8-4b68115e897f tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e" status: 200 len: 287 microversion: 2.1 time: 0.034074 Aug 10 17:16:05.568986 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 103/221] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 17:16:05 2022] GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:06.532957 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f400f7f6-5bda-49ea-adbe-54daccc1a2f3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:06.533572 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f400f7f6-5bda-49ea-adbe-54daccc1a2f3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:06.540679 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f400f7f6-5bda-49ea-adbe-54daccc1a2f3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:06.541390 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f400f7f6-5bda-49ea-adbe-54daccc1a2f3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:06.541834 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f400f7f6-5bda-49ea-adbe-54daccc1a2f3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:06.542626 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f400f7f6-5bda-49ea-adbe-54daccc1a2f3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:06.543097 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f400f7f6-5bda-49ea-adbe-54daccc1a2f3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:06.543527 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f400f7f6-5bda-49ea-adbe-54daccc1a2f3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:06.585744 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f103b0f7-b19d-4309-85c2-dcd8072c1ab7 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba12caf0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:06.632946 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f103b0f7-b19d-4309-85c2-dcd8072c1ab7 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e" status: 200 len: 287 microversion: 2.1 time: 0.054628 Aug 10 17:16:06.633724 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 104/222] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 17:16:06 2022] GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:06.706064 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f400f7f6-5bda-49ea-adbe-54daccc1a2f3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:06.715020 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f400f7f6-5bda-49ea-adbe-54daccc1a2f3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.185994 Aug 10 17:16:06.715603 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 119/223] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:06 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:07.646880 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-81a6327e-4352-4917-9cf5-a1ba2f5f8a04 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba12e790>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:07.681275 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-81a6327e-4352-4917-9cf5-a1ba2f5f8a04 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e" status: 200 len: 287 microversion: 2.1 time: 0.037885 Aug 10 17:16:07.686516 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 105/224] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 17:16:07 2022] GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:07.736666 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c8912c3f-bfa9-44e2-8e7e-c3efdfffb70e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:07.737336 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c8912c3f-bfa9-44e2-8e7e-c3efdfffb70e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:07.744161 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8912c3f-bfa9-44e2-8e7e-c3efdfffb70e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:07.744670 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8912c3f-bfa9-44e2-8e7e-c3efdfffb70e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:07.745117 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8912c3f-bfa9-44e2-8e7e-c3efdfffb70e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:07.745824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8912c3f-bfa9-44e2-8e7e-c3efdfffb70e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:07.746274 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8912c3f-bfa9-44e2-8e7e-c3efdfffb70e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:07.746806 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8912c3f-bfa9-44e2-8e7e-c3efdfffb70e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:07.894716 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c8912c3f-bfa9-44e2-8e7e-c3efdfffb70e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:07.903546 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c8912c3f-bfa9-44e2-8e7e-c3efdfffb70e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.170741 Aug 10 17:16:07.904119 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 120/225] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:07 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:08.693867 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fc33d48b-3b88-4100-b860-257b656b9451 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba12ca60>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:08.726328 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fc33d48b-3b88-4100-b860-257b656b9451 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e" status: 200 len: 287 microversion: 2.1 time: 0.036551 Aug 10 17:16:08.728084 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 106/226] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 17:16:08 2022] GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:08.925559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-68029dac-343d-4f53-a6bd-9b2602d2c7a1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:08.926208 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-68029dac-343d-4f53-a6bd-9b2602d2c7a1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:08.932691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68029dac-343d-4f53-a6bd-9b2602d2c7a1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:08.933187 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68029dac-343d-4f53-a6bd-9b2602d2c7a1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:08.933626 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68029dac-343d-4f53-a6bd-9b2602d2c7a1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:08.934413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68029dac-343d-4f53-a6bd-9b2602d2c7a1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:08.934799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68029dac-343d-4f53-a6bd-9b2602d2c7a1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:08.935225 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68029dac-343d-4f53-a6bd-9b2602d2c7a1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:09.078803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-68029dac-343d-4f53-a6bd-9b2602d2c7a1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:09.088368 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-68029dac-343d-4f53-a6bd-9b2602d2c7a1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.164806 Aug 10 17:16:09.089398 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 121/227] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:08 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:09.740846 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4247357a-1754-4e80-a2ad-f2c627e0ffcc tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba2481f0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:09.775922 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4247357a-1754-4e80-a2ad-f2c627e0ffcc tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e" status: 200 len: 287 microversion: 2.1 time: 0.039979 Aug 10 17:16:09.776493 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 107/228] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 17:16:09 2022] GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:10.112584 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f50c1a32-fdd3-4646-8028-1ef3aa006ff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:10.113197 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f50c1a32-fdd3-4646-8028-1ef3aa006ff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:10.120304 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f50c1a32-fdd3-4646-8028-1ef3aa006ff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:10.120797 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f50c1a32-fdd3-4646-8028-1ef3aa006ff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:10.121234 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f50c1a32-fdd3-4646-8028-1ef3aa006ff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:10.121940 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f50c1a32-fdd3-4646-8028-1ef3aa006ff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:10.122418 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f50c1a32-fdd3-4646-8028-1ef3aa006ff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:10.122850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f50c1a32-fdd3-4646-8028-1ef3aa006ff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:10.297822 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f50c1a32-fdd3-4646-8028-1ef3aa006ff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:10.306601 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f50c1a32-fdd3-4646-8028-1ef3aa006ff8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.197730 Aug 10 17:16:10.307197 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 122/229] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:10 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:10.789081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0026c473-3fe1-4af1-8548-218dab1ca109 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba12f040>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:10.820580 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0026c473-3fe1-4af1-8548-218dab1ca109 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e" status: 200 len: 288 microversion: 2.1 time: 0.035947 Aug 10 17:16:10.821137 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 108/230] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 17:16:10 2022] GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:16:10.832593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-62efae5e-8fd8-4058-922e-e47e8fac8503 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba113160>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:10.973740 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-62efae5e-8fd8-4058-922e-e47e8fac8503 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e" status: 202 len: 0 microversion: 2.1 time: 0.145108 Aug 10 17:16:10.974326 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 123/231] 10.222.0.45 () {58 vars in 1254 bytes} [Wed Aug 10 17:16:10 2022] DELETE /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:16:10.984028 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e7fbdc9f-682f-4077-a5bf-b838ae854490 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba248160>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:11.016093 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e7fbdc9f-682f-4077-a5bf-b838ae854490 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e" status: 200 len: 287 microversion: 2.1 time: 0.036254 Aug 10 17:16:11.016671 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 109/232] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 17:16:10 2022] GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:11.327963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6787c2e8-6e32-4f75-96d9-68feefc536e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:11.328666 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6787c2e8-6e32-4f75-96d9-68feefc536e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:11.334949 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6787c2e8-6e32-4f75-96d9-68feefc536e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:11.335534 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6787c2e8-6e32-4f75-96d9-68feefc536e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:11.343646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6787c2e8-6e32-4f75-96d9-68feefc536e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:11.343646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6787c2e8-6e32-4f75-96d9-68feefc536e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:11.343646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6787c2e8-6e32-4f75-96d9-68feefc536e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:11.343646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6787c2e8-6e32-4f75-96d9-68feefc536e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:11.504437 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6787c2e8-6e32-4f75-96d9-68feefc536e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:11.513516 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6787c2e8-6e32-4f75-96d9-68feefc536e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.189540 Aug 10 17:16:11.514108 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 124/233] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:11 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:12.030222 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ef42d0da-d99f-4b31-a795-30b7737a5a2d tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba12ce50>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:12.060308 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ef42d0da-d99f-4b31-a795-30b7737a5a2d tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e" status: 200 len: 287 microversion: 2.1 time: 0.034426 Aug 10 17:16:12.060877 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 110/234] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 17:16:12 2022] GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:12.535945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c2240121-7d85-491c-a61b-dc034afb1392 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:12.537010 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c2240121-7d85-491c-a61b-dc034afb1392 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:12.545201 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2240121-7d85-491c-a61b-dc034afb1392 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:12.545872 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2240121-7d85-491c-a61b-dc034afb1392 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:12.546471 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2240121-7d85-491c-a61b-dc034afb1392 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:12.547514 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2240121-7d85-491c-a61b-dc034afb1392 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:12.548195 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2240121-7d85-491c-a61b-dc034afb1392 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:12.551049 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2240121-7d85-491c-a61b-dc034afb1392 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:12.719547 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c2240121-7d85-491c-a61b-dc034afb1392 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:12.727671 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c2240121-7d85-491c-a61b-dc034afb1392 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.196341 Aug 10 17:16:12.728257 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 125/235] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:12 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:13.074446 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-df1e0648-18b7-4f66-a737-c7e3448b21a2 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba12f3a0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:13.104451 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-df1e0648-18b7-4f66-a737-c7e3448b21a2 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e" status: 200 len: 287 microversion: 2.1 time: 0.034964 Aug 10 17:16:13.105052 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 111/236] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 17:16:13 2022] GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:13.751835 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-38660d65-7712-44bc-b322-abbd2df5b460 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:13.752549 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-38660d65-7712-44bc-b322-abbd2df5b460 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:13.760679 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38660d65-7712-44bc-b322-abbd2df5b460 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:13.761400 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38660d65-7712-44bc-b322-abbd2df5b460 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:13.762007 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38660d65-7712-44bc-b322-abbd2df5b460 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:13.768576 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38660d65-7712-44bc-b322-abbd2df5b460 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:13.768576 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38660d65-7712-44bc-b322-abbd2df5b460 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:13.768576 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38660d65-7712-44bc-b322-abbd2df5b460 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:13.913558 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-38660d65-7712-44bc-b322-abbd2df5b460 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:13.921731 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-38660d65-7712-44bc-b322-abbd2df5b460 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.174984 Aug 10 17:16:13.922313 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 126/237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:13 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:14.119523 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c3008573-9d9f-4449-b4f5-d8be17d44d69 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba12c8b0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:14.158979 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c3008573-9d9f-4449-b4f5-d8be17d44d69 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e" status: 200 len: 287 microversion: 2.1 time: 0.044978 Aug 10 17:16:14.160063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 112/238] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 17:16:14 2022] GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:14.944314 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d9380a29-f042-4c03-8246-e7ce4422fb48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:14.946514 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d9380a29-f042-4c03-8246-e7ce4422fb48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:14.953980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9380a29-f042-4c03-8246-e7ce4422fb48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:14.954660 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9380a29-f042-4c03-8246-e7ce4422fb48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:14.955146 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9380a29-f042-4c03-8246-e7ce4422fb48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:14.955868 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9380a29-f042-4c03-8246-e7ce4422fb48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:14.956334 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9380a29-f042-4c03-8246-e7ce4422fb48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:14.956763 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9380a29-f042-4c03-8246-e7ce4422fb48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:15.102999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d9380a29-f042-4c03-8246-e7ce4422fb48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:15.110733 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d9380a29-f042-4c03-8246-e7ce4422fb48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.171108 Aug 10 17:16:15.111298 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 127/239] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:14 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:15.172306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9c7748d2-9822-481a-8ac9-8399ca02719f tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba12f0d0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:15.200708 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-9c7748d2-9822-481a-8ac9-8399ca02719f tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] HTTP exception thrown: Snapshot 4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e could not be found. Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9c7748d2-9822-481a-8ac9-8399ca02719f tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Request method failure captured: Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e HTTP/1.1 Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-fRYPTeJYAeJ_4AFoBMM1DNdt8XAyu0Y49M7Q_ga1BVsbHBfX7A215mDjqeQRduq4jYi2xJXA0FkdgzsNPFUE-YPuq-cMYy_ThOoCQz5g9pm609JN1q9cVpcZiAem4K9jzHiqjU2kS-3STT8N4p6DhDcOZDyFVuCRCI_Tw7UxbnglQ Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: 89fcec54c0884d8ba44caf78b72daaef Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1020584055 Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:16:15.203329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:16:15.204653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_89fcec54c0884d8ba44caf78b72daaef", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89fcec54c0884d8ba44caf78b72daaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/89fcec54c0884d8ba44caf78b72daaef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89fcec54c0884d8ba44caf78b72daaef"}]}] Aug 10 17:16:15.204653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1020584055 Aug 10 17:16:15.204653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 89fcec54c0884d8ba44caf78b72daaef Aug 10 17:16:15.204653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1020584055 Aug 10 17:16:15.204653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesSnapshotsTestJSON-1020584055-project Aug 10 17:16:15.204653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:16:15.204653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:16:15.204653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: c8fc720a0b60464bb8e6456aa4e61b2a Aug 10 17:16:15.204653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1020584055-project Aug 10 17:16:15.204653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: Aug 10 17:16:15.204653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Snapshot 4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e could not be found. Aug 10 17:16:15.204653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': '4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e'} Aug 10 17:16:15.204653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e could not be found. (HTTP 404) (Request-ID: req-42160b0a-1087-445a-9e6b-41b5b396d47b) Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:15.205478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 17:16:15.206725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e could not be found. Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 17:16:15.207792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:16:15.209004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e could not be found. Aug 10 17:16:15.209004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:15.209004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:15.209004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:15.209004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:15.209004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:16:15.209004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:16:15.209004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:16:15.209004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:16:15.209004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e could not be found. Aug 10 17:16:15.209004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:15.209004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9c7748d2-9822-481a-8ac9-8399ca02719f tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Returning 404 to user: Snapshot 4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:16:15.209004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9c7748d2-9822-481a-8ac9-8399ca02719f tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e" status: 404 len: 111 microversion: 2.1 time: 0.036956 Aug 10 17:16:15.209729 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 113/240] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 17:16:15 2022] GET /compute/v2.1/os-snapshots/4592299f-fa5b-42cd-a40f-fe1fc3c1bc7e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:16:15.214066 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6454e216-a211-428c-837e-48cb7aff2e10 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba1be1f0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:15.384266 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6454e216-a211-428c-837e-48cb7aff2e10 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb" status: 202 len: 0 microversion: 2.1 time: 0.173844 Aug 10 17:16:15.384425 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 128/241] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 17:16:15 2022] DELETE /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:16:15.389543 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=11 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:15.393964 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c13dcbff-6ed4-414b-a038-bcc0a15e5a7e tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba12c700>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:15.466178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c13dcbff-6ed4-414b-a038-bcc0a15e5a7e tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb" status: 200 len: 345 microversion: 2.1 time: 0.077188 Aug 10 17:16:15.467006 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 114/242] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:16:15 2022] GET /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb => generated 345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:16.137065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d679b765-133b-4487-a47b-603a53f64779 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:16.138138 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d679b765-133b-4487-a47b-603a53f64779 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:16.147927 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d679b765-133b-4487-a47b-603a53f64779 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:16.148476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d679b765-133b-4487-a47b-603a53f64779 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:16.150005 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d679b765-133b-4487-a47b-603a53f64779 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:16.150005 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d679b765-133b-4487-a47b-603a53f64779 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:16.150415 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d679b765-133b-4487-a47b-603a53f64779 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:16.150925 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d679b765-133b-4487-a47b-603a53f64779 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:16.340964 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d679b765-133b-4487-a47b-603a53f64779 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:16.353687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d679b765-133b-4487-a47b-603a53f64779 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1521 microversion: 2.1 time: 0.224099 Aug 10 17:16:16.355165 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 129/243] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:16 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:16.482840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=9 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:16.488919 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ef566628-6788-4419-a5b4-efe75b2ae6c1 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba12faf0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:16.519154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-ef566628-6788-4419-a5b4-efe75b2ae6c1 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] HTTP exception thrown: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ef566628-6788-4419-a5b4-efe75b2ae6c1 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Request method failure captured: Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb HTTP/1.1 Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-fRYPTeJYAeJ_4AFoBMM1DNdt8XAyu0Y49M7Q_ga1BVsbHBfX7A215mDjqeQRduq4jYi2xJXA0FkdgzsNPFUE-YPuq-cMYy_ThOoCQz5g9pm609JN1q9cVpcZiAem4K9jzHiqjU2kS-3STT8N4p6DhDcOZDyFVuCRCI_Tw7UxbnglQ Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: 89fcec54c0884d8ba44caf78b72daaef Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1020584055 Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:16:16.521129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:16:16.523403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_89fcec54c0884d8ba44caf78b72daaef", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89fcec54c0884d8ba44caf78b72daaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/89fcec54c0884d8ba44caf78b72daaef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89fcec54c0884d8ba44caf78b72daaef"}]}] Aug 10 17:16:16.523403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1020584055 Aug 10 17:16:16.523403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 89fcec54c0884d8ba44caf78b72daaef Aug 10 17:16:16.523403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1020584055 Aug 10 17:16:16.523403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesSnapshotsTestJSON-1020584055-project Aug 10 17:16:16.523403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:16:16.523403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:16:16.523403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: c8fc720a0b60464bb8e6456aa4e61b2a Aug 10 17:16:16.523403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1020584055-project Aug 10 17:16:16.523403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: Aug 10 17:16:16.523403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.523403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': '6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb'} Aug 10 17:16:16.523403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. (HTTP 404) (Request-ID: req-d638a183-39c4-454c-9167-5c231e72374f) Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:16.524842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 17:16:16.527921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 17:16:16.530197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:16:16.532519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.532519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.532519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:16.532519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.532519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:16.532519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:16:16.532519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:16:16.532519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:16:16.532519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:16:16.532519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.532519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.532519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ef566628-6788-4419-a5b4-efe75b2ae6c1 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Returning 404 to user: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:16:16.532519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ef566628-6788-4419-a5b4-efe75b2ae6c1 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb" status: 404 len: 109 microversion: 2.1 time: 0.040677 Aug 10 17:16:16.532519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 115/244] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:16:16 2022] GET /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:16:16.550510 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9da93279-a697-4460-8ade-034af8ca6ebf tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba0f6820>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:16.599847 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-9da93279-a697-4460-8ade-034af8ca6ebf tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] HTTP exception thrown: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9da93279-a697-4460-8ade-034af8ca6ebf tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Request method failure captured: Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb HTTP/1.1 Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-fRYPTeJYAeJ_4AFoBMM1DNdt8XAyu0Y49M7Q_ga1BVsbHBfX7A215mDjqeQRduq4jYi2xJXA0FkdgzsNPFUE-YPuq-cMYy_ThOoCQz5g9pm609JN1q9cVpcZiAem4K9jzHiqjU2kS-3STT8N4p6DhDcOZDyFVuCRCI_Tw7UxbnglQ Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: 89fcec54c0884d8ba44caf78b72daaef Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1020584055 Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:16:16.604691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:16:16.607306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_89fcec54c0884d8ba44caf78b72daaef", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89fcec54c0884d8ba44caf78b72daaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/89fcec54c0884d8ba44caf78b72daaef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89fcec54c0884d8ba44caf78b72daaef"}]}] Aug 10 17:16:16.607306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1020584055 Aug 10 17:16:16.607306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 89fcec54c0884d8ba44caf78b72daaef Aug 10 17:16:16.607306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1020584055 Aug 10 17:16:16.607306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesSnapshotsTestJSON-1020584055-project Aug 10 17:16:16.607306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:16:16.607306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:16:16.607306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: c8fc720a0b60464bb8e6456aa4e61b2a Aug 10 17:16:16.607306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1020584055-project Aug 10 17:16:16.607306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: Aug 10 17:16:16.607306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.607306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': '6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb'} Aug 10 17:16:16.607306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. (HTTP 404) (Request-ID: req-a96cd080-e45e-423b-beed-2f45f17f73cc) Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:16.609246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 17:16:16.612028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 17:16:16.615016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:16:16.617539 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.617539 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.617539 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:16.617539 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.617539 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:16.617539 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:16:16.617539 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:16:16.617539 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:16:16.617539 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:16:16.617539 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.617539 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.622408 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9da93279-a697-4460-8ade-034af8ca6ebf tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Returning 404 to user: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:16:16.623868 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9da93279-a697-4460-8ade-034af8ca6ebf tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb" status: 404 len: 109 microversion: 2.1 time: 0.078824 Aug 10 17:16:16.624820 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 130/245] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 17:16:16 2022] DELETE /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:16:16.644086 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b0b00c2f-46df-4120-8aa0-4c5cde3151d3 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Calling method '.version_select at 0x7f7eba12c790>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:16.733023 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-b0b00c2f-46df-4120-8aa0-4c5cde3151d3 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] HTTP exception thrown: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b0b00c2f-46df-4120-8aa0-4c5cde3151d3 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Request method failure captured: Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb HTTP/1.1 Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-fRYPTeJYAeJ_4AFoBMM1DNdt8XAyu0Y49M7Q_ga1BVsbHBfX7A215mDjqeQRduq4jYi2xJXA0FkdgzsNPFUE-YPuq-cMYy_ThOoCQz5g9pm609JN1q9cVpcZiAem4K9jzHiqjU2kS-3STT8N4p6DhDcOZDyFVuCRCI_Tw7UxbnglQ Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: 89fcec54c0884d8ba44caf78b72daaef Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1020584055 Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:16:16.735756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:16:16.736977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_89fcec54c0884d8ba44caf78b72daaef", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89fcec54c0884d8ba44caf78b72daaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/89fcec54c0884d8ba44caf78b72daaef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89fcec54c0884d8ba44caf78b72daaef"}]}] Aug 10 17:16:16.736977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1020584055 Aug 10 17:16:16.736977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 89fcec54c0884d8ba44caf78b72daaef Aug 10 17:16:16.736977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1020584055 Aug 10 17:16:16.736977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesSnapshotsTestJSON-1020584055-project Aug 10 17:16:16.736977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:16:16.736977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:16:16.736977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: c8fc720a0b60464bb8e6456aa4e61b2a Aug 10 17:16:16.736977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1020584055-project Aug 10 17:16:16.736977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: Aug 10 17:16:16.736977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.736977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': '6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb'} Aug 10 17:16:16.736977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. (HTTP 404) (Request-ID: req-5be41eca-ecb9-4a69-a9c0-1d5d0413ec1f) Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:16.737822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 17:16:16.739477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 17:16:16.740589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:16:16.741639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.741639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.741639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:16.741639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.741639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:16.741639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:16:16.741639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:16:16.741639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:16:16.741639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:16:16.741639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. Aug 10 17:16:16.741639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:16.741639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b0b00c2f-46df-4120-8aa0-4c5cde3151d3 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] Returning 404 to user: Volume 6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:16:16.741639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b0b00c2f-46df-4120-8aa0-4c5cde3151d3 tempest-VolumesSnapshotsTestJSON-1020584055 tempest-VolumesSnapshotsTestJSON-1020584055-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb" status: 404 len: 109 microversion: 2.1 time: 0.101336 Aug 10 17:16:16.741639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 116/246] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:16:16 2022] GET /compute/v2.1/os-volumes/6ca7a7a8-ea25-4aaa-8e66-df5a7ced8bdb => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:16:17.392577 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1fe58197-70eb-4240-8e8d-09c3214f13f5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:17.402550 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1fe58197-70eb-4240-8e8d-09c3214f13f5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:17.417182 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1fe58197-70eb-4240-8e8d-09c3214f13f5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:17.418107 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1fe58197-70eb-4240-8e8d-09c3214f13f5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:17.418830 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1fe58197-70eb-4240-8e8d-09c3214f13f5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:17.421146 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1fe58197-70eb-4240-8e8d-09c3214f13f5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:17.421146 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1fe58197-70eb-4240-8e8d-09c3214f13f5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:17.422066 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1fe58197-70eb-4240-8e8d-09c3214f13f5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:17.605431 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1fe58197-70eb-4240-8e8d-09c3214f13f5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:17.607712 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:17.614366 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1fe58197-70eb-4240-8e8d-09c3214f13f5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1501 microversion: 2.1 time: 0.228981 Aug 10 17:16:17.615203 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 131/247] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:17 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1501 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:17.642132 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-70f338f8-e58b-4c65-8760-71c75a3c7083 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:17.642839 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-70f338f8-e58b-4c65-8760-71c75a3c7083 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:17.649442 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70f338f8-e58b-4c65-8760-71c75a3c7083 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:17.650004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70f338f8-e58b-4c65-8760-71c75a3c7083 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:17.650557 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70f338f8-e58b-4c65-8760-71c75a3c7083 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:17.651264 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70f338f8-e58b-4c65-8760-71c75a3c7083 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:17.651726 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70f338f8-e58b-4c65-8760-71c75a3c7083 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:17.652153 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70f338f8-e58b-4c65-8760-71c75a3c7083 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:17.861728 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-70f338f8-e58b-4c65-8760-71c75a3c7083 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:17.880663 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-70f338f8-e58b-4c65-8760-71c75a3c7083 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1515 microversion: 2.1 time: 0.242972 Aug 10 17:16:17.881739 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 117/248] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:17 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:23.600827 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5ff23dce-2316-410b-9279-ca7e1bf7c80f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:23.603911 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5ff23dce-2316-410b-9279-ca7e1bf7c80f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:23.606019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=42 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:23.611458 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ff23dce-2316-410b-9279-ca7e1bf7c80f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:23.611865 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ff23dce-2316-410b-9279-ca7e1bf7c80f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:23.612312 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ff23dce-2316-410b-9279-ca7e1bf7c80f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:23.613029 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ff23dce-2316-410b-9279-ca7e1bf7c80f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:23.613545 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ff23dce-2316-410b-9279-ca7e1bf7c80f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:23.613979 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ff23dce-2316-410b-9279-ca7e1bf7c80f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:23.639827 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-5ff23dce-2316-410b-9279-ca7e1bf7c80f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lazy-loading 'flavor' on Instance uuid df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:16:23.879081 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5ff23dce-2316-410b-9279-ca7e1bf7c80f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "POST /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb/action" status: 200 len: 32 microversion: 2.1 time: 0.282598 Aug 10 17:16:23.879695 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 132/249] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:16:23 2022] POST /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb/action => generated 32 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:16:23.889846 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9b394a62-fc0e-4287-a2ec-e41d05de7fd0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:23.890507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9b394a62-fc0e-4287-a2ec-e41d05de7fd0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:23.897726 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b394a62-fc0e-4287-a2ec-e41d05de7fd0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:23.898216 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b394a62-fc0e-4287-a2ec-e41d05de7fd0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:23.898838 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b394a62-fc0e-4287-a2ec-e41d05de7fd0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:23.899716 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b394a62-fc0e-4287-a2ec-e41d05de7fd0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:23.904958 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b394a62-fc0e-4287-a2ec-e41d05de7fd0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:23.904958 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b394a62-fc0e-4287-a2ec-e41d05de7fd0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:24.039936 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9b394a62-fc0e-4287-a2ec-e41d05de7fd0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:24.047679 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9b394a62-fc0e-4287-a2ec-e41d05de7fd0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.162040 Aug 10 17:16:24.048268 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 118/250] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:23 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:25.075584 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f46f0d2c-fa96-4d4a-9a16-aecdc7d79ea3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:25.076280 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f46f0d2c-fa96-4d4a-9a16-aecdc7d79ea3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:25.082637 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f46f0d2c-fa96-4d4a-9a16-aecdc7d79ea3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:25.083140 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f46f0d2c-fa96-4d4a-9a16-aecdc7d79ea3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:25.083558 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f46f0d2c-fa96-4d4a-9a16-aecdc7d79ea3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:25.084252 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f46f0d2c-fa96-4d4a-9a16-aecdc7d79ea3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:25.084695 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f46f0d2c-fa96-4d4a-9a16-aecdc7d79ea3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:25.085117 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f46f0d2c-fa96-4d4a-9a16-aecdc7d79ea3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:25.242323 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f46f0d2c-fa96-4d4a-9a16-aecdc7d79ea3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:25.249612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f46f0d2c-fa96-4d4a-9a16-aecdc7d79ea3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.178245 Aug 10 17:16:25.250209 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 133/251] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:25 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:26.273008 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-77dd8bd6-2e97-4a2f-b222-1b7de606cb39 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:26.275486 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-77dd8bd6-2e97-4a2f-b222-1b7de606cb39 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:26.283698 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77dd8bd6-2e97-4a2f-b222-1b7de606cb39 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:26.284258 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77dd8bd6-2e97-4a2f-b222-1b7de606cb39 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:26.285574 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77dd8bd6-2e97-4a2f-b222-1b7de606cb39 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:26.286605 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77dd8bd6-2e97-4a2f-b222-1b7de606cb39 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:26.287524 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77dd8bd6-2e97-4a2f-b222-1b7de606cb39 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:26.288528 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77dd8bd6-2e97-4a2f-b222-1b7de606cb39 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:26.444629 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-77dd8bd6-2e97-4a2f-b222-1b7de606cb39 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:26.455186 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-77dd8bd6-2e97-4a2f-b222-1b7de606cb39 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.186191 Aug 10 17:16:26.455768 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 119/252] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:26 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:27.078231 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1321510741", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "networks": [{"uuid": "6209a0e8-5e15-4b1c-90fb-df7a0d8ae5ce"}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:27.135825 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] validate_networks() for [('6209a0e8-5e15-4b1c-90fb-df7a0d8ae5ce', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:16:27.477815 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-41541613-174b-4c0e-b4d3-6bcb79aea937 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:27.478596 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-41541613-174b-4c0e-b4d3-6bcb79aea937 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:27.491532 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41541613-174b-4c0e-b4d3-6bcb79aea937 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:27.491960 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41541613-174b-4c0e-b4d3-6bcb79aea937 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:27.493020 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41541613-174b-4c0e-b4d3-6bcb79aea937 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:27.493745 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41541613-174b-4c0e-b4d3-6bcb79aea937 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:27.494745 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41541613-174b-4c0e-b4d3-6bcb79aea937 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:27.494745 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41541613-174b-4c0e-b4d3-6bcb79aea937 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:27.518395 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:16:27.522204 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:16:27.522204 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:16:27.522204 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:16:27.522204 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:16:27.531567 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:27.532125 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:27.532644 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:27.533663 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:27.534287 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:27.534884 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:27.641908 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-41541613-174b-4c0e-b4d3-6bcb79aea937 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:27.650177 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-41541613-174b-4c0e-b4d3-6bcb79aea937 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.176672 Aug 10 17:16:27.650812 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 120/253] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:27 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:27.697213 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Getting quotas for project f827cc75b1c449f6a82d5c23af901fa0. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:16:27.701653 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Getting quotas for user 44132cbd18f2470dbe9de6b5125d7db5 and project f827cc75b1c449f6a82d5c23af901fa0. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:16:27.713376 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:16:27.715742 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:16:27.910072 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-64bea1c0-b3cc-48d7-b287-4273ea89ee74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835682 Aug 10 17:16:27.910769 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 134/254] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:16:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:16:27.921917 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6b26d8a5-071d-4008-894a-b53f58156a5c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:27.923084 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6b26d8a5-071d-4008-894a-b53f58156a5c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:27.981447 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6b26d8a5-071d-4008-894a-b53f58156a5c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:27.991427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6b26d8a5-071d-4008-894a-b53f58156a5c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1214 microversion: 2.1 time: 0.071104 Aug 10 17:16:27.991427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 121/255] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:27 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:28.673570 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-04328336-eb37-4108-9586-616840810858 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:28.674258 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-04328336-eb37-4108-9586-616840810858 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:28.681353 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04328336-eb37-4108-9586-616840810858 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:28.681845 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04328336-eb37-4108-9586-616840810858 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:28.682322 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04328336-eb37-4108-9586-616840810858 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:28.683064 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04328336-eb37-4108-9586-616840810858 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:28.683579 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04328336-eb37-4108-9586-616840810858 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:28.684010 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04328336-eb37-4108-9586-616840810858 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:28.841169 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-04328336-eb37-4108-9586-616840810858 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:28.849461 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-04328336-eb37-4108-9586-616840810858 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.179998 Aug 10 17:16:28.850031 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 135/256] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:28 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:29.012081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-51266b6c-039d-4c67-b411-235903f93b33 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:29.012713 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-51266b6c-039d-4c67-b411-235903f93b33 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:29.066788 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-51266b6c-039d-4c67-b411-235903f93b33 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:29.074128 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-51266b6c-039d-4c67-b411-235903f93b33 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1214 microversion: 2.1 time: 0.066787 Aug 10 17:16:29.074807 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 122/257] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:29 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:29.870769 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9f944dc9-235e-4e49-826a-885cf7d41194 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:29.871390 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9f944dc9-235e-4e49-826a-885cf7d41194 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:29.877416 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9f944dc9-235e-4e49-826a-885cf7d41194 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:29.877902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9f944dc9-235e-4e49-826a-885cf7d41194 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:29.878338 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9f944dc9-235e-4e49-826a-885cf7d41194 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:29.879062 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9f944dc9-235e-4e49-826a-885cf7d41194 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:29.879512 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9f944dc9-235e-4e49-826a-885cf7d41194 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:29.879938 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9f944dc9-235e-4e49-826a-885cf7d41194 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:30.028529 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9f944dc9-235e-4e49-826a-885cf7d41194 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:30.036266 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9f944dc9-235e-4e49-826a-885cf7d41194 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.169531 Aug 10 17:16:30.036828 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 136/258] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:29 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:30.103829 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c4913828-9eab-405b-8e4c-20686f39e94f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:30.103829 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c4913828-9eab-405b-8e4c-20686f39e94f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:30.103829 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4913828-9eab-405b-8e4c-20686f39e94f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:30.103829 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4913828-9eab-405b-8e4c-20686f39e94f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:30.105954 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4913828-9eab-405b-8e4c-20686f39e94f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:30.105954 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4913828-9eab-405b-8e4c-20686f39e94f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:30.105954 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4913828-9eab-405b-8e4c-20686f39e94f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:30.105954 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4913828-9eab-405b-8e4c-20686f39e94f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:30.168585 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c4913828-9eab-405b-8e4c-20686f39e94f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:30.176235 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c4913828-9eab-405b-8e4c-20686f39e94f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1266 microversion: 2.1 time: 0.085130 Aug 10 17:16:30.176809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 123/259] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:30 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:31.059853 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a8bf753b-2f17-46d9-b1da-3423675c8798 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:31.060572 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a8bf753b-2f17-46d9-b1da-3423675c8798 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:31.068933 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a8bf753b-2f17-46d9-b1da-3423675c8798 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:31.069590 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a8bf753b-2f17-46d9-b1da-3423675c8798 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:31.070302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a8bf753b-2f17-46d9-b1da-3423675c8798 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:31.075102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a8bf753b-2f17-46d9-b1da-3423675c8798 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:31.075102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a8bf753b-2f17-46d9-b1da-3423675c8798 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:31.075102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a8bf753b-2f17-46d9-b1da-3423675c8798 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:31.203852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-463c6d66-a31f-4ae8-affc-450b64950f0c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:31.205358 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-463c6d66-a31f-4ae8-affc-450b64950f0c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:31.216137 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-463c6d66-a31f-4ae8-affc-450b64950f0c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:31.217094 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-463c6d66-a31f-4ae8-affc-450b64950f0c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:31.218403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-463c6d66-a31f-4ae8-affc-450b64950f0c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:31.220259 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-463c6d66-a31f-4ae8-affc-450b64950f0c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:31.221845 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-463c6d66-a31f-4ae8-affc-450b64950f0c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:31.223006 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-463c6d66-a31f-4ae8-affc-450b64950f0c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:31.273571 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a8bf753b-2f17-46d9-b1da-3423675c8798 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:31.281289 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a8bf753b-2f17-46d9-b1da-3423675c8798 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.226765 Aug 10 17:16:31.281951 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 137/260] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:31 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:31.316121 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-463c6d66-a31f-4ae8-affc-450b64950f0c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:31.325341 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-463c6d66-a31f-4ae8-affc-450b64950f0c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1272 microversion: 2.1 time: 0.126915 Aug 10 17:16:31.325917 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 124/261] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:31 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:31.547316 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-88f87c54-af71-450e-b7d2-34d47f424f05 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:31.548451 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-88f87c54-af71-450e-b7d2-34d47f424f05 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:31.555736 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-88f87c54-af71-450e-b7d2-34d47f424f05 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:31.558728 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-88f87c54-af71-450e-b7d2-34d47f424f05 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:31.558728 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-88f87c54-af71-450e-b7d2-34d47f424f05 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:31.558728 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-88f87c54-af71-450e-b7d2-34d47f424f05 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:31.558728 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-88f87c54-af71-450e-b7d2-34d47f424f05 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:31.559168 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-88f87c54-af71-450e-b7d2-34d47f424f05 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:31.603307 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-88f87c54-af71-450e-b7d2-34d47f424f05 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029/ips" status: 200 len: 148 microversion: 2.1 time: 0.062582 Aug 10 17:16:31.604205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 138/262] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 17:16:31 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029/ips => generated 148 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:16:32.318653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d48f0dc2-82c2-4afb-b00f-1325e5a61b5c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:32.321165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d48f0dc2-82c2-4afb-b00f-1325e5a61b5c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:32.332890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d48f0dc2-82c2-4afb-b00f-1325e5a61b5c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:32.333807 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d48f0dc2-82c2-4afb-b00f-1325e5a61b5c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:32.337804 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d48f0dc2-82c2-4afb-b00f-1325e5a61b5c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:32.340003 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d48f0dc2-82c2-4afb-b00f-1325e5a61b5c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:32.340686 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d48f0dc2-82c2-4afb-b00f-1325e5a61b5c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:32.341378 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d48f0dc2-82c2-4afb-b00f-1325e5a61b5c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:32.349872 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c345a32e-a3e0-4d98-82cd-490492207be3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:32.350616 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c345a32e-a3e0-4d98-82cd-490492207be3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:32.359467 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c345a32e-a3e0-4d98-82cd-490492207be3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:32.359973 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c345a32e-a3e0-4d98-82cd-490492207be3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:32.360415 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c345a32e-a3e0-4d98-82cd-490492207be3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:32.365626 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c345a32e-a3e0-4d98-82cd-490492207be3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:32.366498 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c345a32e-a3e0-4d98-82cd-490492207be3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:32.366916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c345a32e-a3e0-4d98-82cd-490492207be3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:32.620688 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d48f0dc2-82c2-4afb-b00f-1325e5a61b5c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:32.628095 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c345a32e-a3e0-4d98-82cd-490492207be3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:32.630871 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c345a32e-a3e0-4d98-82cd-490492207be3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1314 microversion: 2.1 time: 0.287441 Aug 10 17:16:32.631619 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 139/263] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:32 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:32.651881 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d48f0dc2-82c2-4afb-b00f-1325e5a61b5c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.325939 Aug 10 17:16:32.656113 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-e03cce91-5cd2-4923-9e27-861335d927db req-9a2cd304-6abf-4746-a135-7c9859bcb967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed4da58-b964-4217-a794-390738d5e7ca", "tag": "f32c9915-bb51-4858-a858-0a1fec7a0120"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:32.659587 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 125/264] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:32 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:32.665619 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e03cce91-5cd2-4923-9e27-861335d927db req-9a2cd304-6abf-4746-a135-7c9859bcb967 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:32.666102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e03cce91-5cd2-4923-9e27-861335d927db req-9a2cd304-6abf-4746-a135-7c9859bcb967 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:32.666563 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e03cce91-5cd2-4923-9e27-861335d927db req-9a2cd304-6abf-4746-a135-7c9859bcb967 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:32.683969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-e03cce91-5cd2-4923-9e27-861335d927db req-9a2cd304-6abf-4746-a135-7c9859bcb967 service nova] Creating event network-changed:f32c9915-bb51-4858-a858-0a1fec7a0120 for instance 7ed4da58-b964-4217-a794-390738d5e7ca on hv-cinder-85272 Aug 10 17:16:32.689271 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-e03cce91-5cd2-4923-9e27-861335d927db req-9a2cd304-6abf-4746-a135-7c9859bcb967 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042304 Aug 10 17:16:32.690092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 140/265] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:33.355367 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0d2851f7-3646-43fd-ad9e-31a384886990 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86da328c-8b27-4cc4-8d84-43bc342c43b2"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:33.357770 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0d2851f7-3646-43fd-ad9e-31a384886990 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:33.364423 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d2851f7-3646-43fd-ad9e-31a384886990 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:33.364907 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d2851f7-3646-43fd-ad9e-31a384886990 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:33.365342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d2851f7-3646-43fd-ad9e-31a384886990 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:33.366045 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d2851f7-3646-43fd-ad9e-31a384886990 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:33.366534 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d2851f7-3646-43fd-ad9e-31a384886990 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:33.367502 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d2851f7-3646-43fd-ad9e-31a384886990 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:33.654596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1de3b21c-931a-41f1-9237-04e8f594dc91 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:33.656008 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1de3b21c-931a-41f1-9237-04e8f594dc91 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:33.674862 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1de3b21c-931a-41f1-9237-04e8f594dc91 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:33.674862 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1de3b21c-931a-41f1-9237-04e8f594dc91 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:33.674862 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1de3b21c-931a-41f1-9237-04e8f594dc91 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:33.674862 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1de3b21c-931a-41f1-9237-04e8f594dc91 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:33.675263 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1de3b21c-931a-41f1-9237-04e8f594dc91 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:33.675263 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1de3b21c-931a-41f1-9237-04e8f594dc91 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:33.936885 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1de3b21c-931a-41f1-9237-04e8f594dc91 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:33.947503 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1de3b21c-931a-41f1-9237-04e8f594dc91 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1314 microversion: 2.1 time: 0.298887 Aug 10 17:16:33.948445 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 141/266] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:33 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:33.953499 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c59f5822-619e-4678-8cf3-47c71a5b4009 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:33.954414 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c59f5822-619e-4678-8cf3-47c71a5b4009 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:33.964418 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c59f5822-619e-4678-8cf3-47c71a5b4009 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:33.965289 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c59f5822-619e-4678-8cf3-47c71a5b4009 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:33.965892 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c59f5822-619e-4678-8cf3-47c71a5b4009 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:33.968327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c59f5822-619e-4678-8cf3-47c71a5b4009 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:33.968327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c59f5822-619e-4678-8cf3-47c71a5b4009 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:33.968327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c59f5822-619e-4678-8cf3-47c71a5b4009 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:34.160176 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c59f5822-619e-4678-8cf3-47c71a5b4009 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:34.168300 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c59f5822-619e-4678-8cf3-47c71a5b4009 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.218617 Aug 10 17:16:34.169107 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 142/267] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:33 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:34.342009 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0d2851f7-3646-43fd-ad9e-31a384886990 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "POST /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.990581 Aug 10 17:16:34.342657 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 126/268] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 17:16:33 2022] POST /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029/os-volume_attachments => generated 194 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:34.980769 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a63b9008-c97d-4069-ad0d-1b2fe7526606 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:34.983640 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a63b9008-c97d-4069-ad0d-1b2fe7526606 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:34.991321 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a63b9008-c97d-4069-ad0d-1b2fe7526606 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:34.992338 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a63b9008-c97d-4069-ad0d-1b2fe7526606 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:34.993035 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a63b9008-c97d-4069-ad0d-1b2fe7526606 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:34.993798 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a63b9008-c97d-4069-ad0d-1b2fe7526606 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:34.994265 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a63b9008-c97d-4069-ad0d-1b2fe7526606 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:34.994733 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a63b9008-c97d-4069-ad0d-1b2fe7526606 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:35.190826 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e837df00-fae4-45f5-967f-868b7e98683a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:35.191317 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a63b9008-c97d-4069-ad0d-1b2fe7526606 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:35.191544 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e837df00-fae4-45f5-967f-868b7e98683a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:35.198024 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e837df00-fae4-45f5-967f-868b7e98683a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:35.198560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e837df00-fae4-45f5-967f-868b7e98683a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:35.198762 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a63b9008-c97d-4069-ad0d-1b2fe7526606 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1314 microversion: 2.1 time: 0.222620 Aug 10 17:16:35.198995 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e837df00-fae4-45f5-967f-868b7e98683a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:35.199727 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 143/269] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:34 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:35.212281 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e837df00-fae4-45f5-967f-868b7e98683a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:35.212973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e837df00-fae4-45f5-967f-868b7e98683a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:35.213436 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e837df00-fae4-45f5-967f-868b7e98683a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:35.395505 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e837df00-fae4-45f5-967f-868b7e98683a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:35.403899 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e837df00-fae4-45f5-967f-868b7e98683a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.218004 Aug 10 17:16:35.404477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 127/270] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:35 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:36.219790 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-315f3d7a-ef6e-4a25-95ca-edeafd9fea98 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:36.220440 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-315f3d7a-ef6e-4a25-95ca-edeafd9fea98 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:36.227010 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-315f3d7a-ef6e-4a25-95ca-edeafd9fea98 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:36.227479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-315f3d7a-ef6e-4a25-95ca-edeafd9fea98 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:36.228090 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-315f3d7a-ef6e-4a25-95ca-edeafd9fea98 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:36.228744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-315f3d7a-ef6e-4a25-95ca-edeafd9fea98 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:36.229123 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-315f3d7a-ef6e-4a25-95ca-edeafd9fea98 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:36.229548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-315f3d7a-ef6e-4a25-95ca-edeafd9fea98 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:36.378545 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-315f3d7a-ef6e-4a25-95ca-edeafd9fea98 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:36.388235 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-315f3d7a-ef6e-4a25-95ca-edeafd9fea98 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1314 microversion: 2.1 time: 0.172254 Aug 10 17:16:36.388827 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 144/271] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:36 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:36.425645 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-678ac9f9-e516-4eeb-824f-52ad4eeec6cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:36.426261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-678ac9f9-e516-4eeb-824f-52ad4eeec6cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:36.432933 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-678ac9f9-e516-4eeb-824f-52ad4eeec6cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:36.433427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-678ac9f9-e516-4eeb-824f-52ad4eeec6cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:36.433888 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-678ac9f9-e516-4eeb-824f-52ad4eeec6cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:36.434662 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-678ac9f9-e516-4eeb-824f-52ad4eeec6cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:36.435118 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-678ac9f9-e516-4eeb-824f-52ad4eeec6cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:36.435546 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-678ac9f9-e516-4eeb-824f-52ad4eeec6cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:36.627772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-678ac9f9-e516-4eeb-824f-52ad4eeec6cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:36.638785 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-678ac9f9-e516-4eeb-824f-52ad4eeec6cb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.215066 Aug 10 17:16:36.640227 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 128/272] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:36 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:37.409031 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cc16887b-0723-454d-b7cc-f1a94c2881c0 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:37.411420 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cc16887b-0723-454d-b7cc-f1a94c2881c0 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:37.418391 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc16887b-0723-454d-b7cc-f1a94c2881c0 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:37.418999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc16887b-0723-454d-b7cc-f1a94c2881c0 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:37.423504 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc16887b-0723-454d-b7cc-f1a94c2881c0 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:37.423504 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc16887b-0723-454d-b7cc-f1a94c2881c0 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:37.423504 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc16887b-0723-454d-b7cc-f1a94c2881c0 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:37.423504 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc16887b-0723-454d-b7cc-f1a94c2881c0 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:37.586817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cc16887b-0723-454d-b7cc-f1a94c2881c0 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:37.595073 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cc16887b-0723-454d-b7cc-f1a94c2881c0 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1314 microversion: 2.1 time: 0.189807 Aug 10 17:16:37.597004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 145/273] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:37 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:37.661185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2d885a31-e73c-4056-9ebc-8e7bd8b358b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:37.661852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2d885a31-e73c-4056-9ebc-8e7bd8b358b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:37.670960 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2d885a31-e73c-4056-9ebc-8e7bd8b358b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:37.671457 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2d885a31-e73c-4056-9ebc-8e7bd8b358b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:37.672111 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2d885a31-e73c-4056-9ebc-8e7bd8b358b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:37.672823 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2d885a31-e73c-4056-9ebc-8e7bd8b358b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:37.673286 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2d885a31-e73c-4056-9ebc-8e7bd8b358b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:37.673710 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2d885a31-e73c-4056-9ebc-8e7bd8b358b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:37.828622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2d885a31-e73c-4056-9ebc-8e7bd8b358b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:37.838241 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2d885a31-e73c-4056-9ebc-8e7bd8b358b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.180894 Aug 10 17:16:37.839262 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 129/274] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:37 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:38.633441 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9553965a-98e0-418b-b206-c5af09cd665f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:38.634791 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9553965a-98e0-418b-b206-c5af09cd665f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:38.637079 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:38.637754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=6 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:38.645042 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9553965a-98e0-418b-b206-c5af09cd665f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:38.645042 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9553965a-98e0-418b-b206-c5af09cd665f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:38.645042 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9553965a-98e0-418b-b206-c5af09cd665f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:38.645350 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9553965a-98e0-418b-b206-c5af09cd665f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:38.645742 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9553965a-98e0-418b-b206-c5af09cd665f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:38.647955 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9553965a-98e0-418b-b206-c5af09cd665f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:38.830812 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9553965a-98e0-418b-b206-c5af09cd665f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:38.845538 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9553965a-98e0-418b-b206-c5af09cd665f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1314 microversion: 2.1 time: 0.217808 Aug 10 17:16:38.846388 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 146/275] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:38 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:38.861465 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1bce6b2f-90da-4850-9fbb-3605508d83b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:38.862023 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1bce6b2f-90da-4850-9fbb-3605508d83b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:38.869121 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bce6b2f-90da-4850-9fbb-3605508d83b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:38.869611 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bce6b2f-90da-4850-9fbb-3605508d83b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:38.870047 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bce6b2f-90da-4850-9fbb-3605508d83b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:38.870771 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bce6b2f-90da-4850-9fbb-3605508d83b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:38.871251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bce6b2f-90da-4850-9fbb-3605508d83b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:38.871655 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bce6b2f-90da-4850-9fbb-3605508d83b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:39.011503 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1bce6b2f-90da-4850-9fbb-3605508d83b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:39.023745 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1bce6b2f-90da-4850-9fbb-3605508d83b4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.165713 Aug 10 17:16:39.024714 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 130/276] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:38 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:39.865750 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ddb3b3de-2ddf-4648-bdcf-cccbf1eb07bc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:39.866400 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ddb3b3de-2ddf-4648-bdcf-cccbf1eb07bc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:39.874248 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddb3b3de-2ddf-4648-bdcf-cccbf1eb07bc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:39.874779 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddb3b3de-2ddf-4648-bdcf-cccbf1eb07bc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:39.875460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddb3b3de-2ddf-4648-bdcf-cccbf1eb07bc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:39.876419 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddb3b3de-2ddf-4648-bdcf-cccbf1eb07bc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:39.877098 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddb3b3de-2ddf-4648-bdcf-cccbf1eb07bc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:39.877744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddb3b3de-2ddf-4648-bdcf-cccbf1eb07bc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:40.047028 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-02213117-6f6b-4005-ba49-aea7ed17309a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:40.047516 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-02213117-6f6b-4005-ba49-aea7ed17309a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:40.052375 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ddb3b3de-2ddf-4648-bdcf-cccbf1eb07bc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:40.063662 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=4 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:40.071154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02213117-6f6b-4005-ba49-aea7ed17309a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:40.072179 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02213117-6f6b-4005-ba49-aea7ed17309a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:40.075042 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02213117-6f6b-4005-ba49-aea7ed17309a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:40.075968 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02213117-6f6b-4005-ba49-aea7ed17309a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:40.076393 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ddb3b3de-2ddf-4648-bdcf-cccbf1eb07bc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1314 microversion: 2.1 time: 0.211810 Aug 10 17:16:40.078104 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 147/277] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:39 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:40.080368 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02213117-6f6b-4005-ba49-aea7ed17309a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:40.081027 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02213117-6f6b-4005-ba49-aea7ed17309a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:40.324056 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-02213117-6f6b-4005-ba49-aea7ed17309a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:40.334900 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-02213117-6f6b-4005-ba49-aea7ed17309a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.291611 Aug 10 17:16:40.347174 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 131/278] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:40 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:40.980797 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b7159ec5-06c3-475e-8293-d940235a2d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:40.982091 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b7159ec5-06c3-475e-8293-d940235a2d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:40.988984 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7159ec5-06c3-475e-8293-d940235a2d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:40.989176 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7159ec5-06c3-475e-8293-d940235a2d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:40.989553 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7159ec5-06c3-475e-8293-d940235a2d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:40.989658 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-77e285e0-b9fe-4202-b776-53d9ac94fb7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:40.990120 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-77e285e0-b9fe-4202-b776-53d9ac94fb7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:40.990263 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7159ec5-06c3-475e-8293-d940235a2d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:40.990916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7159ec5-06c3-475e-8293-d940235a2d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:40.991490 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7159ec5-06c3-475e-8293-d940235a2d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:41.001013 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77e285e0-b9fe-4202-b776-53d9ac94fb7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:41.001768 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77e285e0-b9fe-4202-b776-53d9ac94fb7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:41.002392 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77e285e0-b9fe-4202-b776-53d9ac94fb7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:41.003356 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77e285e0-b9fe-4202-b776-53d9ac94fb7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:41.003970 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77e285e0-b9fe-4202-b776-53d9ac94fb7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:41.004551 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77e285e0-b9fe-4202-b776-53d9ac94fb7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:41.011568 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:41.019789 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b7159ec5-06c3-475e-8293-d940235a2d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/ips" status: 200 len: 151 microversion: 2.20 time: 0.043242 Aug 10 17:16:41.021683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 148/279] 10.222.0.45 () {60 vars in 1289 bytes} [Wed Aug 10 17:16:40 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 17:16:41.041020 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-77e285e0-b9fe-4202-b776-53d9ac94fb7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/ips" status: 200 len: 145 microversion: 2.1 time: 0.052444 Aug 10 17:16:41.041020 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 132/280] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 17:16:40 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/ips => generated 145 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:16:41.098798 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e29332cf-b53f-44e5-8795-c59c8edcde42 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:41.099604 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e29332cf-b53f-44e5-8795-c59c8edcde42 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:41.114149 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e29332cf-b53f-44e5-8795-c59c8edcde42 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:41.115025 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e29332cf-b53f-44e5-8795-c59c8edcde42 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:41.115728 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e29332cf-b53f-44e5-8795-c59c8edcde42 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:41.117541 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e29332cf-b53f-44e5-8795-c59c8edcde42 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:41.120990 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e29332cf-b53f-44e5-8795-c59c8edcde42 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:41.125895 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e29332cf-b53f-44e5-8795-c59c8edcde42 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:41.153729 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-cd159e51-3afb-4da4-8fde-63f1e3bf1cd4 req-109a52cd-8b0e-4ecd-b288-08c2f0edccba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed4da58-b964-4217-a794-390738d5e7ca", "name": "network-vif-plugged", "status": "completed", "tag": "f32c9915-bb51-4858-a858-0a1fec7a0120"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:41.186558 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-cd159e51-3afb-4da4-8fde-63f1e3bf1cd4 req-109a52cd-8b0e-4ecd-b288-08c2f0edccba service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:41.187051 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-cd159e51-3afb-4da4-8fde-63f1e3bf1cd4 req-109a52cd-8b0e-4ecd-b288-08c2f0edccba service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:41.187489 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-cd159e51-3afb-4da4-8fde-63f1e3bf1cd4 req-109a52cd-8b0e-4ecd-b288-08c2f0edccba service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:41.224551 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-cd159e51-3afb-4da4-8fde-63f1e3bf1cd4 req-109a52cd-8b0e-4ecd-b288-08c2f0edccba service nova] Creating event network-vif-plugged:f32c9915-bb51-4858-a858-0a1fec7a0120 for instance 7ed4da58-b964-4217-a794-390738d5e7ca on hv-cinder-85272 Aug 10 17:16:41.239806 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-cd159e51-3afb-4da4-8fde-63f1e3bf1cd4 req-109a52cd-8b0e-4ecd-b288-08c2f0edccba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091629 Aug 10 17:16:41.240994 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 133/281] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:41.358713 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c0fd1b01-beaa-4bbb-b1a5-8a858f631221 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:41.359796 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c0fd1b01-beaa-4bbb-b1a5-8a858f631221 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:41.369219 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c0fd1b01-beaa-4bbb-b1a5-8a858f631221 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:41.370063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c0fd1b01-beaa-4bbb-b1a5-8a858f631221 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:41.370695 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c0fd1b01-beaa-4bbb-b1a5-8a858f631221 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:41.373029 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c0fd1b01-beaa-4bbb-b1a5-8a858f631221 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:41.373718 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c0fd1b01-beaa-4bbb-b1a5-8a858f631221 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:41.375826 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c0fd1b01-beaa-4bbb-b1a5-8a858f631221 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:41.459367 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e29332cf-b53f-44e5-8795-c59c8edcde42 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:41.471285 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e29332cf-b53f-44e5-8795-c59c8edcde42 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1314 microversion: 2.1 time: 0.377242 Aug 10 17:16:41.475462 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 149/282] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:41 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:41.675384 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c0fd1b01-beaa-4bbb-b1a5-8a858f631221 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:41.684299 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c0fd1b01-beaa-4bbb-b1a5-8a858f631221 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.330695 Aug 10 17:16:41.685216 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 134/283] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:41 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:42.497288 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a0fc54c4-95bf-4a72-9df3-41418e5b0ed2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:42.498447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a0fc54c4-95bf-4a72-9df3-41418e5b0ed2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:42.518952 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a0fc54c4-95bf-4a72-9df3-41418e5b0ed2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:42.519452 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a0fc54c4-95bf-4a72-9df3-41418e5b0ed2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:42.519974 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a0fc54c4-95bf-4a72-9df3-41418e5b0ed2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:42.520757 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a0fc54c4-95bf-4a72-9df3-41418e5b0ed2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:42.524066 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a0fc54c4-95bf-4a72-9df3-41418e5b0ed2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:42.524503 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a0fc54c4-95bf-4a72-9df3-41418e5b0ed2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:42.704411 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a0fc54c4-95bf-4a72-9df3-41418e5b0ed2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:42.705103 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3a098b1f-6ca9-43a2-be8d-3447e7b17498 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:42.705728 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3a098b1f-6ca9-43a2-be8d-3447e7b17498 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:42.713550 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3a098b1f-6ca9-43a2-be8d-3447e7b17498 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:42.713859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a0fc54c4-95bf-4a72-9df3-41418e5b0ed2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1314 microversion: 2.1 time: 0.220653 Aug 10 17:16:42.714701 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3a098b1f-6ca9-43a2-be8d-3447e7b17498 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:42.714898 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 150/284] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:42 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:42.715631 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3a098b1f-6ca9-43a2-be8d-3447e7b17498 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:42.716589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3a098b1f-6ca9-43a2-be8d-3447e7b17498 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:42.737301 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3a098b1f-6ca9-43a2-be8d-3447e7b17498 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:42.737301 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3a098b1f-6ca9-43a2-be8d-3447e7b17498 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:42.742872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:42.899689 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3a098b1f-6ca9-43a2-be8d-3447e7b17498 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:42.910769 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3a098b1f-6ca9-43a2-be8d-3447e7b17498 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.209420 Aug 10 17:16:42.936886 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 135/285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:42 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:43.749255 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d3fa2e70-b2ee-4ec8-923c-3f6c3f07e77c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:43.750013 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d3fa2e70-b2ee-4ec8-923c-3f6c3f07e77c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:43.763274 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3fa2e70-b2ee-4ec8-923c-3f6c3f07e77c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:43.764876 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3fa2e70-b2ee-4ec8-923c-3f6c3f07e77c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:43.766036 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3fa2e70-b2ee-4ec8-923c-3f6c3f07e77c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:43.767568 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3fa2e70-b2ee-4ec8-923c-3f6c3f07e77c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:43.769350 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3fa2e70-b2ee-4ec8-923c-3f6c3f07e77c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:43.770219 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3fa2e70-b2ee-4ec8-923c-3f6c3f07e77c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:43.933172 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bf0d1d41-990d-4a78-a455-3b0da56558be tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:43.933858 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-bf0d1d41-990d-4a78-a455-3b0da56558be tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:43.936331 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d3fa2e70-b2ee-4ec8-923c-3f6c3f07e77c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:43.941690 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf0d1d41-990d-4a78-a455-3b0da56558be tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:43.942429 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf0d1d41-990d-4a78-a455-3b0da56558be tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:43.942676 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf0d1d41-990d-4a78-a455-3b0da56558be tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:43.943706 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf0d1d41-990d-4a78-a455-3b0da56558be tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:43.944047 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf0d1d41-990d-4a78-a455-3b0da56558be tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:43.944345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d3fa2e70-b2ee-4ec8-923c-3f6c3f07e77c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1314 microversion: 2.1 time: 0.200467 Aug 10 17:16:43.944470 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf0d1d41-990d-4a78-a455-3b0da56558be tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:43.944917 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 151/286] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:43 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:44.208272 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4890c8d5-4044-4cb3-983c-6ccf25f7942a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:44.209326 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4890c8d5-4044-4cb3-983c-6ccf25f7942a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:44.221664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4890c8d5-4044-4cb3-983c-6ccf25f7942a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:44.222172 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4890c8d5-4044-4cb3-983c-6ccf25f7942a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:44.225690 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4890c8d5-4044-4cb3-983c-6ccf25f7942a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:44.230152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4890c8d5-4044-4cb3-983c-6ccf25f7942a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:44.230152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4890c8d5-4044-4cb3-983c-6ccf25f7942a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:44.230152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4890c8d5-4044-4cb3-983c-6ccf25f7942a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:44.321150 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-4890c8d5-4044-4cb3-983c-6ccf25f7942a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lazy-loading 'flavor' on Instance uuid 1e46673f-6139-4b97-b57a-b65886eb16b1 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:16:44.587907 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bf0d1d41-990d-4a78-a455-3b0da56558be tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:44.599616 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bf0d1d41-990d-4a78-a455-3b0da56558be tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.668559 Aug 10 17:16:44.601769 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 136/287] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:43 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:44.974524 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4b1b1313-5f59-46ba-b0a3-461dd4cb9575 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:44.974524 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4b1b1313-5f59-46ba-b0a3-461dd4cb9575 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:44.985704 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1b1313-5f59-46ba-b0a3-461dd4cb9575 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:44.987721 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1b1313-5f59-46ba-b0a3-461dd4cb9575 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:44.988988 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1b1313-5f59-46ba-b0a3-461dd4cb9575 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:44.993074 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1b1313-5f59-46ba-b0a3-461dd4cb9575 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:44.993869 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1b1313-5f59-46ba-b0a3-461dd4cb9575 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:44.995949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1b1313-5f59-46ba-b0a3-461dd4cb9575 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:45.098244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4890c8d5-4044-4cb3-983c-6ccf25f7942a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "POST /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/action" status: 202 len: 0 microversion: 2.20 time: 0.895514 Aug 10 17:16:45.100144 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 152/288] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 10 17:16:44 2022] POST /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/action => generated 0 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:16:45.111547 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-34d24cbe-30db-49f0-b081-3a7617a5d0de tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:45.112332 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-34d24cbe-30db-49f0-b081-3a7617a5d0de tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:45.120399 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34d24cbe-30db-49f0-b081-3a7617a5d0de tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:45.120898 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34d24cbe-30db-49f0-b081-3a7617a5d0de tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:45.121532 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34d24cbe-30db-49f0-b081-3a7617a5d0de tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:45.122775 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34d24cbe-30db-49f0-b081-3a7617a5d0de tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:45.123394 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34d24cbe-30db-49f0-b081-3a7617a5d0de tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:45.123978 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34d24cbe-30db-49f0-b081-3a7617a5d0de tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:45.557411 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4b1b1313-5f59-46ba-b0a3-461dd4cb9575 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:45.567568 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4b1b1313-5f59-46ba-b0a3-461dd4cb9575 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1314 microversion: 2.1 time: 0.604191 Aug 10 17:16:45.582997 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 137/289] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:44 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:45.627875 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c4b37803-4cfe-470f-91be-5d204afc131d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Action: 'create', calling method: .version_select at 0x7f7eba12cd30>, body: {"keypair": {"name": "tempest-keypair-2100369984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2/8W2pP0t0b8iGGIF4znXVxP7VfdlTpB1JzpTrHt3T5pytyI7anGzI47APSJmee9AymIdAiGcbsy7L6oH20H2EAwtH+ElJM4TY0pYavW1OxG9z+XPcwiUkmZzK2YLzwA=="}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:45.643140 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=47 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:45.658262 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-c4b37803-4cfe-470f-91be-5d204afc131d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:16:45.664723 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-c4b37803-4cfe-470f-91be-5d204afc131d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for user 48feb2fc02f04e739c5e1bf7d68baa16 and project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:16:45.727088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-34d24cbe-30db-49f0-b081-3a7617a5d0de tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:45.740800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-34d24cbe-30db-49f0-b081-3a7617a5d0de tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:45.744302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-34d24cbe-30db-49f0-b081-3a7617a5d0de tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:45.746491 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-34d24cbe-30db-49f0-b081-3a7617a5d0de tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.640483 Aug 10 17:16:45.747501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 153/290] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:16:45 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:16:45.755580 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fb29a27d-8a4e-4a2e-84cd-cd022ea63497 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c172be9d-c219-4275-bc2b-bc5d6168dda6"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:45.760205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fb29a27d-8a4e-4a2e-84cd-cd022ea63497 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:45.780686 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c4b37803-4cfe-470f-91be-5d204afc131d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.196273 Aug 10 17:16:45.782242 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 138/291] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 17:16:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:45.784694 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb29a27d-8a4e-4a2e-84cd-cd022ea63497 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:45.789789 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb29a27d-8a4e-4a2e-84cd-cd022ea63497 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:45.789789 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb29a27d-8a4e-4a2e-84cd-cd022ea63497 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:45.789789 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb29a27d-8a4e-4a2e-84cd-cd022ea63497 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:45.789789 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb29a27d-8a4e-4a2e-84cd-cd022ea63497 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:45.790201 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb29a27d-8a4e-4a2e-84cd-cd022ea63497 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:45.792311 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d66a4ca9-cd15-42f7-ace8-e04865711b9b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:45.792948 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d66a4ca9-cd15-42f7-ace8-e04865711b9b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:45.802427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d66a4ca9-cd15-42f7-ace8-e04865711b9b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:45.803198 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d66a4ca9-cd15-42f7-ace8-e04865711b9b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:45.803982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d66a4ca9-cd15-42f7-ace8-e04865711b9b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:45.805238 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d66a4ca9-cd15-42f7-ace8-e04865711b9b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:45.806267 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d66a4ca9-cd15-42f7-ace8-e04865711b9b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:45.807114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d66a4ca9-cd15-42f7-ace8-e04865711b9b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:46.086033 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d66a4ca9-cd15-42f7-ace8-e04865711b9b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:46.095712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d66a4ca9-cd15-42f7-ace8-e04865711b9b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.312058 Aug 10 17:16:46.096269 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 139/292] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:45 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:46.599788 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-113391a1-ee14-4808-a71f-0f826ec4bf05 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:46.602715 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-113391a1-ee14-4808-a71f-0f826ec4bf05 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:46.628462 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-113391a1-ee14-4808-a71f-0f826ec4bf05 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:46.629271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-113391a1-ee14-4808-a71f-0f826ec4bf05 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:46.631041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-113391a1-ee14-4808-a71f-0f826ec4bf05 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:46.633261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-113391a1-ee14-4808-a71f-0f826ec4bf05 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:46.634439 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-113391a1-ee14-4808-a71f-0f826ec4bf05 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:46.635506 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-113391a1-ee14-4808-a71f-0f826ec4bf05 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:46.908347 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-113391a1-ee14-4808-a71f-0f826ec4bf05 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:46.917362 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-113391a1-ee14-4808-a71f-0f826ec4bf05 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1496 microversion: 2.1 time: 0.325111 Aug 10 17:16:46.917959 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 140/293] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:46 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1496 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:46.923161 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a3a745b0-ec2c-4404-8f21-6f0a3183f8f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:46.924184 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a3a745b0-ec2c-4404-8f21-6f0a3183f8f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:46.931359 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3a745b0-ec2c-4404-8f21-6f0a3183f8f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:46.931979 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3a745b0-ec2c-4404-8f21-6f0a3183f8f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:46.932429 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3a745b0-ec2c-4404-8f21-6f0a3183f8f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:46.933162 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3a745b0-ec2c-4404-8f21-6f0a3183f8f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:46.933631 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3a745b0-ec2c-4404-8f21-6f0a3183f8f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:46.934232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3a745b0-ec2c-4404-8f21-6f0a3183f8f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:47.372805 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a3a745b0-ec2c-4404-8f21-6f0a3183f8f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:47.381240 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a3a745b0-ec2c-4404-8f21-6f0a3183f8f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:47.383081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a3a745b0-ec2c-4404-8f21-6f0a3183f8f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:47.384501 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a3a745b0-ec2c-4404-8f21-6f0a3183f8f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.465432 Aug 10 17:16:47.385134 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 141/294] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:16:46 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:16:47.390137 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e72c7d4d-99f8-44b3-8a0f-018a2b06b329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:47.390867 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e72c7d4d-99f8-44b3-8a0f-018a2b06b329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:47.397632 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e72c7d4d-99f8-44b3-8a0f-018a2b06b329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:47.410243 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e72c7d4d-99f8-44b3-8a0f-018a2b06b329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:47.410243 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e72c7d4d-99f8-44b3-8a0f-018a2b06b329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:47.410243 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e72c7d4d-99f8-44b3-8a0f-018a2b06b329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:47.410243 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e72c7d4d-99f8-44b3-8a0f-018a2b06b329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:47.410725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e72c7d4d-99f8-44b3-8a0f-018a2b06b329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:47.545896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e72c7d4d-99f8-44b3-8a0f-018a2b06b329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:47.560216 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e72c7d4d-99f8-44b3-8a0f-018a2b06b329 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1501 microversion: 2.1 time: 0.173840 Aug 10 17:16:47.573202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 142/295] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:47 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1501 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:47.582109 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d96584fb-d590-4a50-8488-aa84c16de2ff tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84f7b158-cd45-43ff-aa9e-facfc3d3ce00"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:47.584814 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d96584fb-d590-4a50-8488-aa84c16de2ff tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:47.599940 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d96584fb-d590-4a50-8488-aa84c16de2ff tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:47.602918 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d96584fb-d590-4a50-8488-aa84c16de2ff tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:47.609290 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d96584fb-d590-4a50-8488-aa84c16de2ff tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:47.610113 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d96584fb-d590-4a50-8488-aa84c16de2ff tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:47.610640 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d96584fb-d590-4a50-8488-aa84c16de2ff tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:47.611082 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d96584fb-d590-4a50-8488-aa84c16de2ff tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:47.648441 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-d96584fb-d590-4a50-8488-aa84c16de2ff tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] HTTP exception thrown: Cannot 'attach_volume' instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb while it is in vm_state rescued Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d96584fb-d590-4a50-8488-aa84c16de2ff tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Request method failure captured: Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: POST /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb/os-volume_attachments HTTP/1.1 Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 74 Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-dswVGFX6YnssvSdTDTGYKFuPUcQkPiuoht6xjK41FLbLRERzNejhLlYaJj4B97fXmairLkYtq3qAN844xnnJD_nNs69F67xjXDl2MQv0g2LKJF8vMzfdI49Cx11gpD5xAT_u8QAAlFxfzo1W-6WvyoQXKrMEdXy7XIMxCTOEUbAnc Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: 2eb3ea42180f4a0ca5ca3c90962fb301 Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:16:47.650288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:16:47.651697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2eb3ea42180f4a0ca5ca3c90962fb301", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2eb3ea42180f4a0ca5ca3c90962fb301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2eb3ea42180f4a0ca5ca3c90962fb301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2eb3ea42180f4a0ca5ca3c90962fb301"}]}] Aug 10 17:16:47.651697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:16:47.651697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 2eb3ea42180f4a0ca5ca3c90962fb301 Aug 10 17:16:47.651697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:16:47.651697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-ServerRescueNegativeTestJSON-1974687270-project Aug 10 17:16:47.651697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:16:47.651697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:16:47.651697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 7d2a65984c4f42fbb18977c7345c42ce Aug 10 17:16:47.651697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1974687270-project Aug 10 17:16:47.651697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Aug 10 17:16:47.651697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {"volumeAttachment": {"volumeId": "84f7b158-cd45-43ff-aa9e-facfc3d3ce00"}} Aug 10 17:16:47.651697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Cannot 'attach_volume' instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb while it is in vm_state rescued Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'server_id': 'df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb', 'body': {'volumeAttachment': {'volumeId': '84f7b158-cd45-43ff-aa9e-facfc3d3ce00'}}} Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:16:47.656035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb while it is in vm_state rescued Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:16:47.657349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:16:47.658734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:16:47.658734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:16:47.658734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb while it is in vm_state rescued Aug 10 17:16:47.658734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:47.658734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d96584fb-d590-4a50-8488-aa84c16de2ff tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Returning 409 to user: Cannot 'attach_volume' instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb while it is in vm_state rescued {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:16:47.658734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d96584fb-d590-4a50-8488-aa84c16de2ff tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "POST /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074114 Aug 10 17:16:47.658734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 143/296] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 17:16:47 2022] POST /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb/os-volume_attachments => generated 152 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 10 17:16:47.664363 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b59b8fd3-3473-42fa-9c4b-cebb466a876e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:47.666914 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b59b8fd3-3473-42fa-9c4b-cebb466a876e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:47.671597 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b59b8fd3-3473-42fa-9c4b-cebb466a876e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:47.672101 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b59b8fd3-3473-42fa-9c4b-cebb466a876e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:47.672545 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b59b8fd3-3473-42fa-9c4b-cebb466a876e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:47.673254 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b59b8fd3-3473-42fa-9c4b-cebb466a876e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:47.673713 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b59b8fd3-3473-42fa-9c4b-cebb466a876e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:47.674143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b59b8fd3-3473-42fa-9c4b-cebb466a876e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:47.918060 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b59b8fd3-3473-42fa-9c4b-cebb466a876e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "POST /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb/action" status: 202 len: 0 microversion: 2.1 time: 0.256516 Aug 10 17:16:47.922123 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 144/297] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:16:47 2022] POST /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:16:47.936536 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2b93b92d-a658-4984-a41e-5ad3f26d8bc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:47.937345 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2b93b92d-a658-4984-a41e-5ad3f26d8bc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:47.944406 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b93b92d-a658-4984-a41e-5ad3f26d8bc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:47.945525 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b93b92d-a658-4984-a41e-5ad3f26d8bc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:47.946130 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b93b92d-a658-4984-a41e-5ad3f26d8bc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:47.954260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b93b92d-a658-4984-a41e-5ad3f26d8bc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:47.954260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b93b92d-a658-4984-a41e-5ad3f26d8bc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:47.954260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b93b92d-a658-4984-a41e-5ad3f26d8bc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:48.063726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fb29a27d-8a4e-4a2e-84cd-cd022ea63497 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "POST /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.314688 Aug 10 17:16:48.069664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 154/298] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 17:16:45 2022] POST /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/os-volume_attachments => generated 194 bytes in 2316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:48.174533 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2b93b92d-a658-4984-a41e-5ad3f26d8bc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:48.193082 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2b93b92d-a658-4984-a41e-5ad3f26d8bc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1509 microversion: 2.1 time: 0.262635 Aug 10 17:16:48.195127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 145/299] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:47 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:48.347498 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8a8a9a91-fe50-46d9-bf92-e3d35c3d5553 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:48.348476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8a8a9a91-fe50-46d9-bf92-e3d35c3d5553 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:48.358553 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a8a9a91-fe50-46d9-bf92-e3d35c3d5553 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:48.365477 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a8a9a91-fe50-46d9-bf92-e3d35c3d5553 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:48.365477 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a8a9a91-fe50-46d9-bf92-e3d35c3d5553 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:48.365477 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a8a9a91-fe50-46d9-bf92-e3d35c3d5553 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:48.365477 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a8a9a91-fe50-46d9-bf92-e3d35c3d5553 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:48.366052 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a8a9a91-fe50-46d9-bf92-e3d35c3d5553 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:48.409455 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5147ae0d-8e14-4eef-a883-58b982a0bc3c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:48.410194 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5147ae0d-8e14-4eef-a883-58b982a0bc3c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:48.416927 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8a8a9a91-fe50-46d9-bf92-e3d35c3d5553 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:16:48.419929 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5147ae0d-8e14-4eef-a883-58b982a0bc3c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:48.420446 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5147ae0d-8e14-4eef-a883-58b982a0bc3c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:48.423965 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5147ae0d-8e14-4eef-a883-58b982a0bc3c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:48.427045 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5147ae0d-8e14-4eef-a883-58b982a0bc3c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:48.427740 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5147ae0d-8e14-4eef-a883-58b982a0bc3c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:48.429603 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5147ae0d-8e14-4eef-a883-58b982a0bc3c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:48.807351 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5147ae0d-8e14-4eef-a883-58b982a0bc3c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:48.816008 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5147ae0d-8e14-4eef-a883-58b982a0bc3c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:48.817628 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5147ae0d-8e14-4eef-a883-58b982a0bc3c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:48.818973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5147ae0d-8e14-4eef-a883-58b982a0bc3c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.413559 Aug 10 17:16:48.834377 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 146/300] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:16:48 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:16:48.916546 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8a8a9a91-fe50-46d9-bf92-e3d35c3d5553 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 204 len: 0 microversion: 2.1 time: 0.573416 Aug 10 17:16:48.919505 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 155/301] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:16:48 2022] DELETE /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:16:48.928162 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-484a8fac-ab52-4b42-a76d-3f4c4ac74619 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:48.928894 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-484a8fac-ab52-4b42-a76d-3f4c4ac74619 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:48.936921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-484a8fac-ab52-4b42-a76d-3f4c4ac74619 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:48.937706 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-484a8fac-ab52-4b42-a76d-3f4c4ac74619 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:48.938379 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-484a8fac-ab52-4b42-a76d-3f4c4ac74619 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:48.939400 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-484a8fac-ab52-4b42-a76d-3f4c4ac74619 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:48.940204 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-484a8fac-ab52-4b42-a76d-3f4c4ac74619 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:48.940800 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-484a8fac-ab52-4b42-a76d-3f4c4ac74619 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:49.201190 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-484a8fac-ab52-4b42-a76d-3f4c4ac74619 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:49.210067 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-484a8fac-ab52-4b42-a76d-3f4c4ac74619 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1502 microversion: 2.1 time: 0.285802 Aug 10 17:16:49.225342 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-21ca3472-bc4f-4c77-ab20-f0e477bcbd01 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:49.225894 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-21ca3472-bc4f-4c77-ab20-f0e477bcbd01 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:49.230316 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 147/302] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:48 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1502 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:49.245411 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21ca3472-bc4f-4c77-ab20-f0e477bcbd01 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:49.246077 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21ca3472-bc4f-4c77-ab20-f0e477bcbd01 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:49.248242 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21ca3472-bc4f-4c77-ab20-f0e477bcbd01 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:49.248242 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21ca3472-bc4f-4c77-ab20-f0e477bcbd01 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:49.248431 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21ca3472-bc4f-4c77-ab20-f0e477bcbd01 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:49.248963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21ca3472-bc4f-4c77-ab20-f0e477bcbd01 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:49.524378 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-21ca3472-bc4f-4c77-ab20-f0e477bcbd01 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:49.533641 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-21ca3472-bc4f-4c77-ab20-f0e477bcbd01 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1509 microversion: 2.1 time: 0.313549 Aug 10 17:16:49.535257 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 156/303] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:49 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1509 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:49.668077 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-969920868", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df762851-303d-4aa3-ad7c-336bef1a7d98"}], "security_groups": [{"name": "tempest-securitygroup--1009574047"}], "key_name": "tempest-keypair-2100369984", "user_data": "}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:49.845342 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7239473f-cdf1-4d54-af03-6b023ab613fc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:49.846373 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7239473f-cdf1-4d54-af03-6b023ab613fc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:49.856876 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7239473f-cdf1-4d54-af03-6b023ab613fc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:49.861468 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7239473f-cdf1-4d54-af03-6b023ab613fc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:49.862086 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7239473f-cdf1-4d54-af03-6b023ab613fc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:49.862992 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7239473f-cdf1-4d54-af03-6b023ab613fc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:49.867221 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] validate_networks() for [('df762851-303d-4aa3-ad7c-336bef1a7d98', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:16:49.872783 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7239473f-cdf1-4d54-af03-6b023ab613fc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:49.873380 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7239473f-cdf1-4d54-af03-6b023ab613fc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:50.454194 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7239473f-cdf1-4d54-af03-6b023ab613fc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:50.463451 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7239473f-cdf1-4d54-af03-6b023ab613fc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:50.465226 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7239473f-cdf1-4d54-af03-6b023ab613fc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:50.466607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7239473f-cdf1-4d54-af03-6b023ab613fc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.625395 Aug 10 17:16:50.469341 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 157/304] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:16:49 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:16:50.472537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0bdfdc35-e73c-4202-9712-2ca83066b3de tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:50.473332 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0bdfdc35-e73c-4202-9712-2ca83066b3de tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:50.479940 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0bdfdc35-e73c-4202-9712-2ca83066b3de tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:50.480672 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0bdfdc35-e73c-4202-9712-2ca83066b3de tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:50.481257 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0bdfdc35-e73c-4202-9712-2ca83066b3de tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:50.482106 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0bdfdc35-e73c-4202-9712-2ca83066b3de tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:50.482740 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0bdfdc35-e73c-4202-9712-2ca83066b3de tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:50.483475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0bdfdc35-e73c-4202-9712-2ca83066b3de tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:50.740059 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0bdfdc35-e73c-4202-9712-2ca83066b3de tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:50.749043 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0bdfdc35-e73c-4202-9712-2ca83066b3de tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1502 microversion: 2.1 time: 0.279606 Aug 10 17:16:50.763887 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 158/305] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:50 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1502 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:50.824934 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:16:50.825528 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:16:50.825919 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:16:50.826388 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:16:50.826806 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:16:50.838065 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:50.838065 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:50.838065 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:50.838065 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:50.838516 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:50.839013 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:50.857954 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:16:50.862241 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for user 48feb2fc02f04e739c5e1bf7d68baa16 and project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:16:50.874424 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:16:50.876704 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:16:50.966688 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0199df75-b855-48f7-8688-30aa32f229d4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Action: 'create', calling method: .version_select at 0x7f7eba2588b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1509534705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLu5zM+Dy2UFKW+FzbJaSDNcSXTp7MB31Vomy7k5BXjor1wa25hT7oWcxDSU+tOsG2p244zDKD4DcoD50WJKPic2Jle/AdSMoxVHazbQtv7ZIc1B497/L+mKQBKKbDvmBQ=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:50.982950 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-0199df75-b855-48f7-8688-30aa32f229d4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Getting quotas for project e1bc63782f1d4b32ab58852232df16ac. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:16:50.987206 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-0199df75-b855-48f7-8688-30aa32f229d4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Getting quotas for user 22a5224313e04d35af7fc7802ef5d6ed and project e1bc63782f1d4b32ab58852232df16ac. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:16:50.991095 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3fc21022-0976-415b-b77f-1f4344151f96 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.327873 Aug 10 17:16:50.992386 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 148/306] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:16:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:16:50.997835 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-13c63cc7-4197-4603-b2c7-88a6d40acb63 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:50.998960 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-13c63cc7-4197-4603-b2c7-88a6d40acb63 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:51.006253 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13c63cc7-4197-4603-b2c7-88a6d40acb63 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:51.006778 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13c63cc7-4197-4603-b2c7-88a6d40acb63 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:51.008220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13c63cc7-4197-4603-b2c7-88a6d40acb63 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:51.009176 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13c63cc7-4197-4603-b2c7-88a6d40acb63 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:51.009648 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13c63cc7-4197-4603-b2c7-88a6d40acb63 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:51.010081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13c63cc7-4197-4603-b2c7-88a6d40acb63 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:51.071172 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0199df75-b855-48f7-8688-30aa32f229d4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.305756 Aug 10 17:16:51.072149 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 159/307] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 17:16:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:51.077106 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9f71ae05-64c5-450e-a9d2-00be85ad7e50 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:51.078186 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9f71ae05-64c5-450e-a9d2-00be85ad7e50 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:51.175319 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9f71ae05-64c5-450e-a9d2-00be85ad7e50 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:51.186727 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9f71ae05-64c5-450e-a9d2-00be85ad7e50 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1241 microversion: 2.1 time: 0.111018 Aug 10 17:16:51.187504 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 160/308] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:51 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:51.263997 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-13c63cc7-4197-4603-b2c7-88a6d40acb63 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:51.272182 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-13c63cc7-4197-4603-b2c7-88a6d40acb63 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1509 microversion: 2.1 time: 0.278548 Aug 10 17:16:51.273207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 149/309] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:50 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:51.495123 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c2e1ad99-9c90-42b7-a101-ac89d039d6b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:51.496057 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c2e1ad99-9c90-42b7-a101-ac89d039d6b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:51.505205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2e1ad99-9c90-42b7-a101-ac89d039d6b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:51.512291 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2e1ad99-9c90-42b7-a101-ac89d039d6b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:51.512291 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2e1ad99-9c90-42b7-a101-ac89d039d6b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:51.512291 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2e1ad99-9c90-42b7-a101-ac89d039d6b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:51.512291 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2e1ad99-9c90-42b7-a101-ac89d039d6b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:51.513029 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2e1ad99-9c90-42b7-a101-ac89d039d6b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:51.704190 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c2e1ad99-9c90-42b7-a101-ac89d039d6b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:51.714525 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c2e1ad99-9c90-42b7-a101-ac89d039d6b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:51.716083 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c2e1ad99-9c90-42b7-a101-ac89d039d6b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:51.720053 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c2e1ad99-9c90-42b7-a101-ac89d039d6b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.228900 Aug 10 17:16:51.720730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 161/310] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:16:51 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:16:51.769793 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-84973058-1a54-4cfa-88cd-87b3aa183075 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:51.770459 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-84973058-1a54-4cfa-88cd-87b3aa183075 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:51.777304 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-84973058-1a54-4cfa-88cd-87b3aa183075 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:51.777828 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-84973058-1a54-4cfa-88cd-87b3aa183075 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:51.778270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-84973058-1a54-4cfa-88cd-87b3aa183075 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:51.778997 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-84973058-1a54-4cfa-88cd-87b3aa183075 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:51.779455 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-84973058-1a54-4cfa-88cd-87b3aa183075 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:51.779884 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-84973058-1a54-4cfa-88cd-87b3aa183075 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:51.939195 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-84973058-1a54-4cfa-88cd-87b3aa183075 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:51.941258 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-84973058-1a54-4cfa-88cd-87b3aa183075 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1502 microversion: 2.1 time: 0.175309 Aug 10 17:16:51.941832 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 150/311] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:51 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:52.207671 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-30305ec6-e1c5-4b69-8d6f-ece6f287abae tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:52.208294 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-30305ec6-e1c5-4b69-8d6f-ece6f287abae tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:52.214994 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-30305ec6-e1c5-4b69-8d6f-ece6f287abae tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:52.215485 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-30305ec6-e1c5-4b69-8d6f-ece6f287abae tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:52.221154 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-30305ec6-e1c5-4b69-8d6f-ece6f287abae tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:52.221154 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-30305ec6-e1c5-4b69-8d6f-ece6f287abae tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:52.221154 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-30305ec6-e1c5-4b69-8d6f-ece6f287abae tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:52.221154 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-30305ec6-e1c5-4b69-8d6f-ece6f287abae tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:52.221752 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:52.294993 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-dd65b6f3-a18a-4c70-8476-21ede88a62dd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:52.296269 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-dd65b6f3-a18a-4c70-8476-21ede88a62dd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:52.313465 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-30305ec6-e1c5-4b69-8d6f-ece6f287abae tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:52.314728 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd65b6f3-a18a-4c70-8476-21ede88a62dd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:52.315237 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd65b6f3-a18a-4c70-8476-21ede88a62dd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:52.315682 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd65b6f3-a18a-4c70-8476-21ede88a62dd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:52.316397 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd65b6f3-a18a-4c70-8476-21ede88a62dd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:52.322764 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-30305ec6-e1c5-4b69-8d6f-ece6f287abae tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1245 microversion: 2.1 time: 0.117627 Aug 10 17:16:52.322764 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 162/312] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:52 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1245 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:52.323816 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd65b6f3-a18a-4c70-8476-21ede88a62dd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:52.324597 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd65b6f3-a18a-4c70-8476-21ede88a62dd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:52.503904 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dd65b6f3-a18a-4c70-8476-21ede88a62dd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:52.513530 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-dd65b6f3-a18a-4c70-8476-21ede88a62dd tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1509 microversion: 2.1 time: 0.223356 Aug 10 17:16:52.526793 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 151/313] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:52 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:52.746483 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e2136b2c-8e15-4c07-a228-988a0cb34222 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:52.747836 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e2136b2c-8e15-4c07-a228-988a0cb34222 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:52.761040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2136b2c-8e15-4c07-a228-988a0cb34222 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:52.762148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2136b2c-8e15-4c07-a228-988a0cb34222 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:52.763195 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2136b2c-8e15-4c07-a228-988a0cb34222 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:52.764774 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2136b2c-8e15-4c07-a228-988a0cb34222 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:52.765422 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2136b2c-8e15-4c07-a228-988a0cb34222 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:52.766093 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2136b2c-8e15-4c07-a228-988a0cb34222 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:52.918746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e2136b2c-8e15-4c07-a228-988a0cb34222 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:52.927386 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e2136b2c-8e15-4c07-a228-988a0cb34222 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:52.928905 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e2136b2c-8e15-4c07-a228-988a0cb34222 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:52.931015 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e2136b2c-8e15-4c07-a228-988a0cb34222 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.190000 Aug 10 17:16:52.931825 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 163/314] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:16:52 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:16:52.963962 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8df50620-7712-4d4e-9812-b0a6f40da07c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:52.964587 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8df50620-7712-4d4e-9812-b0a6f40da07c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:52.973356 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8df50620-7712-4d4e-9812-b0a6f40da07c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:52.973685 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8df50620-7712-4d4e-9812-b0a6f40da07c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:52.974329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8df50620-7712-4d4e-9812-b0a6f40da07c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:52.978892 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8df50620-7712-4d4e-9812-b0a6f40da07c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:52.978892 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8df50620-7712-4d4e-9812-b0a6f40da07c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:52.978892 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8df50620-7712-4d4e-9812-b0a6f40da07c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:53.155301 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8df50620-7712-4d4e-9812-b0a6f40da07c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:53.159293 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:53.164459 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8df50620-7712-4d4e-9812-b0a6f40da07c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1502 microversion: 2.1 time: 0.205119 Aug 10 17:16:53.165049 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 152/315] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:52 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:53.321803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-41541b53-aaa2-4f36-bbc1-1baa7960a2a4 req-f2568b3e-fe94-4beb-97d5-2fd554e70e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed4da58-b964-4217-a794-390738d5e7ca", "name": "network-vif-deleted", "tag": "f32c9915-bb51-4858-a858-0a1fec7a0120"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:53.333561 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-41541b53-aaa2-4f36-bbc1-1baa7960a2a4 req-f2568b3e-fe94-4beb-97d5-2fd554e70e56 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:53.334559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-41541b53-aaa2-4f36-bbc1-1baa7960a2a4 req-f2568b3e-fe94-4beb-97d5-2fd554e70e56 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:53.345854 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-41541b53-aaa2-4f36-bbc1-1baa7960a2a4 req-f2568b3e-fe94-4beb-97d5-2fd554e70e56 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:53.346744 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0b37aa13-6bbf-4783-9f43-ec3f61f1c592 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:53.346744 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0b37aa13-6bbf-4783-9f43-ec3f61f1c592 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:53.348828 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-41541b53-aaa2-4f36-bbc1-1baa7960a2a4 req-f2568b3e-fe94-4beb-97d5-2fd554e70e56 service nova] Creating event network-vif-deleted:f32c9915-bb51-4858-a858-0a1fec7a0120 for instance 7ed4da58-b964-4217-a794-390738d5e7ca on hv-cinder-85272 Aug 10 17:16:53.354838 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b37aa13-6bbf-4783-9f43-ec3f61f1c592 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:53.355649 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b37aa13-6bbf-4783-9f43-ec3f61f1c592 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:53.356237 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b37aa13-6bbf-4783-9f43-ec3f61f1c592 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:53.356561 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-41541b53-aaa2-4f36-bbc1-1baa7960a2a4 req-f2568b3e-fe94-4beb-97d5-2fd554e70e56 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038425 Aug 10 17:16:53.357743 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 164/316] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:53.358296 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b37aa13-6bbf-4783-9f43-ec3f61f1c592 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:53.358910 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b37aa13-6bbf-4783-9f43-ec3f61f1c592 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:53.359497 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b37aa13-6bbf-4783-9f43-ec3f61f1c592 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:53.487733 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0b37aa13-6bbf-4783-9f43-ec3f61f1c592 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:53.511748 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0b37aa13-6bbf-4783-9f43-ec3f61f1c592 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1245 microversion: 2.1 time: 0.173496 Aug 10 17:16:53.514104 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 153/317] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:53 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1245 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:53.535266 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6630602d-6276-4158-a015-5502cccce3d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:53.540909 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6630602d-6276-4158-a015-5502cccce3d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:53.547287 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6630602d-6276-4158-a015-5502cccce3d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:53.547784 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6630602d-6276-4158-a015-5502cccce3d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:53.548406 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6630602d-6276-4158-a015-5502cccce3d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:53.549632 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6630602d-6276-4158-a015-5502cccce3d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:53.550239 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6630602d-6276-4158-a015-5502cccce3d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:53.555168 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6630602d-6276-4158-a015-5502cccce3d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:53.749182 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6d27166e-eac2-4b38-b7e5-f229ca46ade5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:53.756133 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d27166e-eac2-4b38-b7e5-f229ca46ade5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:53.756702 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d27166e-eac2-4b38-b7e5-f229ca46ade5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:53.762616 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d27166e-eac2-4b38-b7e5-f229ca46ade5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:53.776449 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6630602d-6276-4158-a015-5502cccce3d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:53.787038 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6630602d-6276-4158-a015-5502cccce3d0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1515 microversion: 2.1 time: 0.255691 Aug 10 17:16:53.788445 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 165/318] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:53 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1515 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:53.868064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6d27166e-eac2-4b38-b7e5-f229ca46ade5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Going to try to stop instance {{(pid=121231) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 17:16:53.958062 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-71ee3816-0c44-47a3-894c-b9f3693469bc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:53.958820 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-71ee3816-0c44-47a3-894c-b9f3693469bc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:53.961708 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:53.967604 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71ee3816-0c44-47a3-894c-b9f3693469bc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:53.967604 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71ee3816-0c44-47a3-894c-b9f3693469bc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:53.968031 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71ee3816-0c44-47a3-894c-b9f3693469bc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:53.968834 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71ee3816-0c44-47a3-894c-b9f3693469bc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:53.969326 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71ee3816-0c44-47a3-894c-b9f3693469bc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:53.969766 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71ee3816-0c44-47a3-894c-b9f3693469bc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:54.126971 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-71ee3816-0c44-47a3-894c-b9f3693469bc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:54.137342 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-71ee3816-0c44-47a3-894c-b9f3693469bc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:54.139483 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-71ee3816-0c44-47a3-894c-b9f3693469bc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:54.147401 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-71ee3816-0c44-47a3-894c-b9f3693469bc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.189123 Aug 10 17:16:54.147401 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 166/319] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:16:53 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:16:54.185874 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0153da39-ba4e-422e-90e4-c36839ae2cd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:54.191006 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0153da39-ba4e-422e-90e4-c36839ae2cd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:54.200782 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0153da39-ba4e-422e-90e4-c36839ae2cd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:54.201563 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0153da39-ba4e-422e-90e4-c36839ae2cd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:54.202159 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0153da39-ba4e-422e-90e4-c36839ae2cd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:54.203047 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0153da39-ba4e-422e-90e4-c36839ae2cd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:54.203435 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0153da39-ba4e-422e-90e4-c36839ae2cd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:54.204065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0153da39-ba4e-422e-90e4-c36839ae2cd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:54.239600 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0153da39-ba4e-422e-90e4-c36839ae2cd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:54.240092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0153da39-ba4e-422e-90e4-c36839ae2cd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:54.240533 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0153da39-ba4e-422e-90e4-c36839ae2cd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:54.240985 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-0153da39-ba4e-422e-90e4-c36839ae2cd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lazy-loading 'fault' on Instance uuid 7ed4da58-b964-4217-a794-390738d5e7ca {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:16:54.254191 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6d27166e-eac2-4b38-b7e5-f229ca46ade5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "POST /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/action" status: 202 len: 0 microversion: 2.1 time: 0.508844 Aug 10 17:16:54.258343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 154/320] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:16:53 2022] POST /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:16:54.265982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e1428d25-fc9b-4fc2-ae8f-aec01ece66e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:54.267177 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e1428d25-fc9b-4fc2-ae8f-aec01ece66e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:54.276440 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1428d25-fc9b-4fc2-ae8f-aec01ece66e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:54.278430 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1428d25-fc9b-4fc2-ae8f-aec01ece66e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:54.279119 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1428d25-fc9b-4fc2-ae8f-aec01ece66e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:54.280071 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1428d25-fc9b-4fc2-ae8f-aec01ece66e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:54.281650 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1428d25-fc9b-4fc2-ae8f-aec01ece66e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:54.282310 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1428d25-fc9b-4fc2-ae8f-aec01ece66e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:54.295321 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0153da39-ba4e-422e-90e4-c36839ae2cd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:54.304847 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0153da39-ba4e-422e-90e4-c36839ae2cd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1304 microversion: 2.1 time: 0.122209 Aug 10 17:16:54.314415 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 167/321] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:54 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:54.468900 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e1428d25-fc9b-4fc2-ae8f-aec01ece66e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:54.479414 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e1428d25-fc9b-4fc2-ae8f-aec01ece66e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.219328 Aug 10 17:16:54.480872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 155/322] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:54 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:54.540517 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b51207a3-9099-458a-8782-45f955ed3be3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:54.541463 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b51207a3-9099-458a-8782-45f955ed3be3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:54.551133 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b51207a3-9099-458a-8782-45f955ed3be3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:54.551728 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b51207a3-9099-458a-8782-45f955ed3be3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:54.552565 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b51207a3-9099-458a-8782-45f955ed3be3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:54.553541 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b51207a3-9099-458a-8782-45f955ed3be3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:54.553988 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b51207a3-9099-458a-8782-45f955ed3be3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:54.554505 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b51207a3-9099-458a-8782-45f955ed3be3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:54.621307 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b51207a3-9099-458a-8782-45f955ed3be3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:54.629468 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b51207a3-9099-458a-8782-45f955ed3be3 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1293 microversion: 2.1 time: 0.093682 Aug 10 17:16:54.633326 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 168/323] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:54 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:55.167715 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3f72fb8d-275a-447a-9945-33c78ef5a813 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:55.168327 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3f72fb8d-275a-447a-9945-33c78ef5a813 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:55.175525 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3f72fb8d-275a-447a-9945-33c78ef5a813 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:55.176012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3f72fb8d-275a-447a-9945-33c78ef5a813 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:55.176450 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3f72fb8d-275a-447a-9945-33c78ef5a813 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:55.177142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3f72fb8d-275a-447a-9945-33c78ef5a813 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:55.179778 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3f72fb8d-275a-447a-9945-33c78ef5a813 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:55.179778 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3f72fb8d-275a-447a-9945-33c78ef5a813 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:55.309666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3f72fb8d-275a-447a-9945-33c78ef5a813 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:55.317640 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3f72fb8d-275a-447a-9945-33c78ef5a813 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:55.319100 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3f72fb8d-275a-447a-9945-33c78ef5a813 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:55.321589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3f72fb8d-275a-447a-9945-33c78ef5a813 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.158025 Aug 10 17:16:55.322141 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 156/324] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:16:55 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:16:55.326768 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-129b5ddd-1eca-43e9-88a3-646bb6b07004 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:55.327382 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-129b5ddd-1eca-43e9-88a3-646bb6b07004 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:55.334932 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b5ddd-1eca-43e9-88a3-646bb6b07004 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:55.335439 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b5ddd-1eca-43e9-88a3-646bb6b07004 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:55.335937 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b5ddd-1eca-43e9-88a3-646bb6b07004 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:55.346317 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b5ddd-1eca-43e9-88a3-646bb6b07004 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:55.346317 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b5ddd-1eca-43e9-88a3-646bb6b07004 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:55.346317 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b5ddd-1eca-43e9-88a3-646bb6b07004 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:55.370784 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b5ddd-1eca-43e9-88a3-646bb6b07004 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:55.371264 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b5ddd-1eca-43e9-88a3-646bb6b07004 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:55.371700 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b5ddd-1eca-43e9-88a3-646bb6b07004 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:55.372150 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-129b5ddd-1eca-43e9-88a3-646bb6b07004 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lazy-loading 'fault' on Instance uuid 7ed4da58-b964-4217-a794-390738d5e7ca {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:16:55.417296 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-129b5ddd-1eca-43e9-88a3-646bb6b07004 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:55.427545 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-129b5ddd-1eca-43e9-88a3-646bb6b07004 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1304 microversion: 2.1 time: 0.104491 Aug 10 17:16:55.428124 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 169/325] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:55 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:55.503563 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b8e0c785-3d38-4b7f-bdbe-37f212147d03 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:55.504178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b8e0c785-3d38-4b7f-bdbe-37f212147d03 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:55.511373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8e0c785-3d38-4b7f-bdbe-37f212147d03 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:55.511906 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8e0c785-3d38-4b7f-bdbe-37f212147d03 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:55.512338 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8e0c785-3d38-4b7f-bdbe-37f212147d03 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:55.513023 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8e0c785-3d38-4b7f-bdbe-37f212147d03 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:55.513472 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8e0c785-3d38-4b7f-bdbe-37f212147d03 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:55.516559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8e0c785-3d38-4b7f-bdbe-37f212147d03 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:55.648765 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b8e0c785-3d38-4b7f-bdbe-37f212147d03 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:55.660315 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b8e0c785-3d38-4b7f-bdbe-37f212147d03 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.161299 Aug 10 17:16:55.661211 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-72c70e7e-e6bb-4291-8b98-c50e898e0804 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:55.662127 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-72c70e7e-e6bb-4291-8b98-c50e898e0804 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:55.668726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-72c70e7e-e6bb-4291-8b98-c50e898e0804 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:55.669434 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-72c70e7e-e6bb-4291-8b98-c50e898e0804 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:55.670070 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-72c70e7e-e6bb-4291-8b98-c50e898e0804 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:55.670996 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-72c70e7e-e6bb-4291-8b98-c50e898e0804 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:55.671640 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-72c70e7e-e6bb-4291-8b98-c50e898e0804 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:55.672498 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-72c70e7e-e6bb-4291-8b98-c50e898e0804 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:55.676005 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 157/326] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:55 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:55.740604 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-72c70e7e-e6bb-4291-8b98-c50e898e0804 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:55.749863 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-72c70e7e-e6bb-4291-8b98-c50e898e0804 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1293 microversion: 2.1 time: 0.094754 Aug 10 17:16:55.750786 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 170/327] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:55 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:56.344688 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cce77ebf-7e93-476e-937d-4fd854e33631 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:56.345381 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cce77ebf-7e93-476e-937d-4fd854e33631 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:56.352310 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cce77ebf-7e93-476e-937d-4fd854e33631 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:56.352827 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cce77ebf-7e93-476e-937d-4fd854e33631 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:56.353249 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cce77ebf-7e93-476e-937d-4fd854e33631 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:56.353950 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cce77ebf-7e93-476e-937d-4fd854e33631 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:56.354441 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cce77ebf-7e93-476e-937d-4fd854e33631 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:56.354871 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cce77ebf-7e93-476e-937d-4fd854e33631 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:56.453759 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8a635a4c-cf3f-42f2-9821-c4ce05cfdfde tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:56.455038 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8a635a4c-cf3f-42f2-9821-c4ce05cfdfde tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:56.462328 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a635a4c-cf3f-42f2-9821-c4ce05cfdfde tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:56.463057 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a635a4c-cf3f-42f2-9821-c4ce05cfdfde tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:56.463494 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a635a4c-cf3f-42f2-9821-c4ce05cfdfde tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:56.464206 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a635a4c-cf3f-42f2-9821-c4ce05cfdfde tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:56.464819 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a635a4c-cf3f-42f2-9821-c4ce05cfdfde tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:56.465407 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a635a4c-cf3f-42f2-9821-c4ce05cfdfde tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:56.506845 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a635a4c-cf3f-42f2-9821-c4ce05cfdfde tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:56.508323 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a635a4c-cf3f-42f2-9821-c4ce05cfdfde tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:56.508783 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a635a4c-cf3f-42f2-9821-c4ce05cfdfde tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:56.509354 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-8a635a4c-cf3f-42f2-9821-c4ce05cfdfde tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lazy-loading 'fault' on Instance uuid 7ed4da58-b964-4217-a794-390738d5e7ca {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:16:56.567738 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8a635a4c-cf3f-42f2-9821-c4ce05cfdfde tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:56.572113 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cce77ebf-7e93-476e-937d-4fd854e33631 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:56.582757 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8a635a4c-cf3f-42f2-9821-c4ce05cfdfde tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1304 microversion: 2.1 time: 0.137523 Aug 10 17:16:56.583855 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cce77ebf-7e93-476e-937d-4fd854e33631 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:56.597348 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 171/328] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:56 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:56.597842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cce77ebf-7e93-476e-937d-4fd854e33631 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:56.597842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cce77ebf-7e93-476e-937d-4fd854e33631 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.246686 Aug 10 17:16:56.597842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 158/329] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:16:56 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:16:56.681800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-70e21c27-9139-4b64-a4f9-f4f2b4f3f04a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:56.682477 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-70e21c27-9139-4b64-a4f9-f4f2b4f3f04a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:56.689433 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70e21c27-9139-4b64-a4f9-f4f2b4f3f04a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:56.689935 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70e21c27-9139-4b64-a4f9-f4f2b4f3f04a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:56.690464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70e21c27-9139-4b64-a4f9-f4f2b4f3f04a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:56.691183 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70e21c27-9139-4b64-a4f9-f4f2b4f3f04a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:56.691645 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70e21c27-9139-4b64-a4f9-f4f2b4f3f04a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:56.692075 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70e21c27-9139-4b64-a4f9-f4f2b4f3f04a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:56.773522 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b8fecfe9-8848-47e7-9545-2148155ee36c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:56.774409 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b8fecfe9-8848-47e7-9545-2148155ee36c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:56.780662 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8fecfe9-8848-47e7-9545-2148155ee36c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:56.781153 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8fecfe9-8848-47e7-9545-2148155ee36c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:56.781683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8fecfe9-8848-47e7-9545-2148155ee36c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:56.782469 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8fecfe9-8848-47e7-9545-2148155ee36c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:56.782762 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8fecfe9-8848-47e7-9545-2148155ee36c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:56.783192 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8fecfe9-8848-47e7-9545-2148155ee36c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:56.896067 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b8fecfe9-8848-47e7-9545-2148155ee36c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:56.903542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b8fecfe9-8848-47e7-9545-2148155ee36c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1293 microversion: 2.1 time: 0.135534 Aug 10 17:16:56.904145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 159/330] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:56 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1293 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:56.924424 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-70e21c27-9139-4b64-a4f9-f4f2b4f3f04a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:56.933115 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-70e21c27-9139-4b64-a4f9-f4f2b4f3f04a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.255372 Aug 10 17:16:56.933685 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 172/331] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:56 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:57.605866 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e68c6044-4dce-4899-88ba-149cfe66030f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:57.606800 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e68c6044-4dce-4899-88ba-149cfe66030f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:57.614126 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e68c6044-4dce-4899-88ba-149cfe66030f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:57.614652 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e68c6044-4dce-4899-88ba-149cfe66030f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:57.615307 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e68c6044-4dce-4899-88ba-149cfe66030f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:57.616001 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e68c6044-4dce-4899-88ba-149cfe66030f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:57.616695 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e68c6044-4dce-4899-88ba-149cfe66030f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:57.617184 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e68c6044-4dce-4899-88ba-149cfe66030f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:57.626053 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bfaf4598-e733-4760-9af6-4023a58247d4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:57.626705 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bfaf4598-e733-4760-9af6-4023a58247d4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:57.634323 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfaf4598-e733-4760-9af6-4023a58247d4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:57.635074 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfaf4598-e733-4760-9af6-4023a58247d4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:57.635671 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfaf4598-e733-4760-9af6-4023a58247d4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:57.636685 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfaf4598-e733-4760-9af6-4023a58247d4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:57.637368 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfaf4598-e733-4760-9af6-4023a58247d4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:57.637868 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfaf4598-e733-4760-9af6-4023a58247d4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:57.652657 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e68c6044-4dce-4899-88ba-149cfe66030f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:57.653306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e68c6044-4dce-4899-88ba-149cfe66030f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:57.653756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e68c6044-4dce-4899-88ba-149cfe66030f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:57.654229 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-e68c6044-4dce-4899-88ba-149cfe66030f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lazy-loading 'fault' on Instance uuid 7ed4da58-b964-4217-a794-390738d5e7ca {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:16:57.711806 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e68c6044-4dce-4899-88ba-149cfe66030f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:57.719442 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e68c6044-4dce-4899-88ba-149cfe66030f tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 200 len: 1304 microversion: 2.1 time: 0.117933 Aug 10 17:16:57.719999 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 160/332] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:57 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:57.807402 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bfaf4598-e733-4760-9af6-4023a58247d4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:57.816085 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bfaf4598-e733-4760-9af6-4023a58247d4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:57.817573 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bfaf4598-e733-4760-9af6-4023a58247d4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:57.818977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bfaf4598-e733-4760-9af6-4023a58247d4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.197686 Aug 10 17:16:57.822792 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 173/333] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:16:57 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:16:57.925356 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-eba7e0e1-668b-401b-887c-c5df48680fd7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:57.926059 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-eba7e0e1-668b-401b-887c-c5df48680fd7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:57.933549 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eba7e0e1-668b-401b-887c-c5df48680fd7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:57.934043 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eba7e0e1-668b-401b-887c-c5df48680fd7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:57.934721 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eba7e0e1-668b-401b-887c-c5df48680fd7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:57.935615 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eba7e0e1-668b-401b-887c-c5df48680fd7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:57.936237 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eba7e0e1-668b-401b-887c-c5df48680fd7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:57.936677 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eba7e0e1-668b-401b-887c-c5df48680fd7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:57.956566 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-42cc8898-c785-4ea8-b459-3bf65bd5a097 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:57.958040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-42cc8898-c785-4ea8-b459-3bf65bd5a097 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:57.966022 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-42cc8898-c785-4ea8-b459-3bf65bd5a097 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:57.966647 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-42cc8898-c785-4ea8-b459-3bf65bd5a097 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:57.967151 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-42cc8898-c785-4ea8-b459-3bf65bd5a097 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:57.967913 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-42cc8898-c785-4ea8-b459-3bf65bd5a097 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:57.968566 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-42cc8898-c785-4ea8-b459-3bf65bd5a097 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:57.969456 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-42cc8898-c785-4ea8-b459-3bf65bd5a097 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:58.009697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-eba7e0e1-668b-401b-887c-c5df48680fd7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:58.027970 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-eba7e0e1-668b-401b-887c-c5df48680fd7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1301 microversion: 2.1 time: 0.106669 Aug 10 17:16:58.029259 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 161/334] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:57 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:58.139895 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-42cc8898-c785-4ea8-b459-3bf65bd5a097 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:58.150002 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-42cc8898-c785-4ea8-b459-3bf65bd5a097 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.199374 Aug 10 17:16:58.150647 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 174/335] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:57 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:16:58.744821 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e5f444dd-ea7c-42b3-ae71-13472ba9c471 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:58.746463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e5f444dd-ea7c-42b3-ae71-13472ba9c471 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: 7ed4da58-b964-4217-a794-390738d5e7ca] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:58.758776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5f444dd-ea7c-42b3-ae71-13472ba9c471 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:58.759509 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5f444dd-ea7c-42b3-ae71-13472ba9c471 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:58.760306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5f444dd-ea7c-42b3-ae71-13472ba9c471 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:58.761784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5f444dd-ea7c-42b3-ae71-13472ba9c471 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:58.762880 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5f444dd-ea7c-42b3-ae71-13472ba9c471 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:58.763676 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5f444dd-ea7c-42b3-ae71-13472ba9c471 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:58.789712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-e5f444dd-ea7c-42b3-ae71-13472ba9c471 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] HTTP exception thrown: Instance 7ed4da58-b964-4217-a794-390738d5e7ca could not be found. Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e5f444dd-ea7c-42b3-ae71-13472ba9c471 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Request method failure captured: Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca HTTP/1.1 Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-fkB40Jh40Snr6UDJpADVpR47UYDvjWvEY6Xb146R4aZ2qjxQaCG2tRt-wJQc5aGlo0u60LezKNejFkhs7V2GKaYZ4Sj0xGW4ZumiB1Igtto8Yf4sASY_n6jcBJoe8sGkY1Es93Wf_AbFkqtrCOr5BbxufQFRAKf0HJFQel_4PDq3s Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: f827cc75b1c449f6a82d5c23af901fa0 Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesActionsTest-964342551 Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:16:58.791865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:16:58.793302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f827cc75b1c449f6a82d5c23af901fa0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f827cc75b1c449f6a82d5c23af901fa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f827cc75b1c449f6a82d5c23af901fa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f827cc75b1c449f6a82d5c23af901fa0"}]}] Aug 10 17:16:58.793302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesActionsTest-964342551 Aug 10 17:16:58.793302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: f827cc75b1c449f6a82d5c23af901fa0 Aug 10 17:16:58.793302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesActionsTest-964342551 Aug 10 17:16:58.793302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesActionsTest-964342551-project Aug 10 17:16:58.793302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:16:58.793302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:16:58.793302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 44132cbd18f2470dbe9de6b5125d7db5 Aug 10 17:16:58.793302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesActionsTest-964342551-project Aug 10 17:16:58.793302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:16:58.793302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance 7ed4da58-b964-4217-a794-390738d5e7ca could not be found. Aug 10 17:16:58.793302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': '7ed4da58-b964-4217-a794-390738d5e7ca'} Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed4da58-b964-4217-a794-390738d5e7ca could not be found. Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:16:58.794139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed4da58-b964-4217-a794-390738d5e7ca could not be found. Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed4da58-b964-4217-a794-390738d5e7ca could not be found. Aug 10 17:16:58.795579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:16:58.796827 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e5f444dd-ea7c-42b3-ae71-13472ba9c471 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Returning 404 to user: Instance 7ed4da58-b964-4217-a794-390738d5e7ca could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:16:58.796827 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e5f444dd-ea7c-42b3-ae71-13472ba9c471 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca" status: 404 len: 111 microversion: 2.1 time: 0.056780 Aug 10 17:16:58.805947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 162/336] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:58 2022] GET /compute/v2.1/servers/7ed4da58-b964-4217-a794-390738d5e7ca => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:16:58.844121 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0806858f-25ae-457d-9aa7-bdcf5447a673 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:58.845331 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0806858f-25ae-457d-9aa7-bdcf5447a673 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:58.853560 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0806858f-25ae-457d-9aa7-bdcf5447a673 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:58.854054 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0806858f-25ae-457d-9aa7-bdcf5447a673 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:58.854954 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0806858f-25ae-457d-9aa7-bdcf5447a673 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:58.855834 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0806858f-25ae-457d-9aa7-bdcf5447a673 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:58.856445 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0806858f-25ae-457d-9aa7-bdcf5447a673 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:58.856883 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0806858f-25ae-457d-9aa7-bdcf5447a673 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:58.921678 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-49fb3134-c091-49d5-a9e0-6c66e924af30 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Action: 'create', calling method: .version_select at 0x7f7eba1be310>, body: {"keypair": {"name": "tempest-keypair-653254705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTVIiQOs9nqizsO5KAv8en1HAybvAMGykSUOUobuZqJeaDJzu/VJ432QkIS8i+B1CdwC2CoF53VaNw15r1c+yjuD8kFey6NCbF0KtME3sR0zbNkr4hns1Xv6ydMYK5vnQ=="}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:58.953889 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-49fb3134-c091-49d5-a9e0-6c66e924af30 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Getting quotas for project 2eb3ea42180f4a0ca5ca3c90962fb301. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:16:58.960784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-49fb3134-c091-49d5-a9e0-6c66e924af30 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Getting quotas for user 7d2a65984c4f42fbb18977c7345c42ce and project 2eb3ea42180f4a0ca5ca3c90962fb301. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:16:59.063706 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-49fb3134-c091-49d5-a9e0-6c66e924af30 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.147126 Aug 10 17:16:59.064554 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 163/337] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 17:16:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:16:59.067052 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0806858f-25ae-457d-9aa7-bdcf5447a673 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:59.072560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-165225876", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "networks": [{"uuid": "6209a0e8-5e15-4b1c-90fb-df7a0d8ae5ce"}]}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:59.081400 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0806858f-25ae-457d-9aa7-bdcf5447a673 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:59.083532 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0806858f-25ae-457d-9aa7-bdcf5447a673 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:59.087102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0806858f-25ae-457d-9aa7-bdcf5447a673 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.245345 Aug 10 17:16:59.087102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 175/338] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:16:58 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:16:59.093620 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c5307faa-acc2-43e4-9c21-63da9195ba24 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:59.095023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c5307faa-acc2-43e4-9c21-63da9195ba24 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:59.105284 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c5307faa-acc2-43e4-9c21-63da9195ba24 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:59.110193 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c5307faa-acc2-43e4-9c21-63da9195ba24 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:59.110193 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c5307faa-acc2-43e4-9c21-63da9195ba24 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:59.110193 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c5307faa-acc2-43e4-9c21-63da9195ba24 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:59.110193 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c5307faa-acc2-43e4-9c21-63da9195ba24 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:59.111225 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c5307faa-acc2-43e4-9c21-63da9195ba24 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:59.168525 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] validate_networks() for [('6209a0e8-5e15-4b1c-90fb-df7a0d8ae5ce', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:16:59.353709 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c5307faa-acc2-43e4-9c21-63da9195ba24 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:59.363053 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c5307faa-acc2-43e4-9c21-63da9195ba24 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.274796 Aug 10 17:16:59.363717 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 176/339] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:59 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:59.383497 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-015fd32c-02fe-414f-a0c6-2d038c4abd6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:59.384130 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-015fd32c-02fe-414f-a0c6-2d038c4abd6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:59.390831 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-015fd32c-02fe-414f-a0c6-2d038c4abd6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:59.391636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-015fd32c-02fe-414f-a0c6-2d038c4abd6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:59.392089 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-015fd32c-02fe-414f-a0c6-2d038c4abd6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:59.392933 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-015fd32c-02fe-414f-a0c6-2d038c4abd6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:59.393417 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-015fd32c-02fe-414f-a0c6-2d038c4abd6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:59.394124 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-015fd32c-02fe-414f-a0c6-2d038c4abd6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:59.618388 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-015fd32c-02fe-414f-a0c6-2d038c4abd6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:16:59.628034 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-015fd32c-02fe-414f-a0c6-2d038c4abd6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.249222 Aug 10 17:16:59.628979 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 177/340] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:59 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:16:59.741118 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:16:59.741593 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:16:59.742130 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:16:59.742693 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:16:59.746632 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:16:59.752676 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:59.753421 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:59.754571 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:59.755331 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:59.755792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:59.756221 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:59.776299 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Getting quotas for project f827cc75b1c449f6a82d5c23af901fa0. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:16:59.780913 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Getting quotas for user 44132cbd18f2470dbe9de6b5125d7db5 and project f827cc75b1c449f6a82d5c23af901fa0. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:16:59.799003 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:16:59.802079 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:16:59.807951 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:16:59.903904 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-cf97ce5d-8ca0-48c6-8da5-b8430cf31faf req-a9b8be9d-9123-4f69-a9b9-233174dd08e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceaebb89-9428-4490-bb2f-fe34917029df", "tag": "91640510-d3e4-4993-9b5c-ceecbca49523"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:16:59.915088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-cf97ce5d-8ca0-48c6-8da5-b8430cf31faf req-a9b8be9d-9123-4f69-a9b9-233174dd08e7 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:16:59.915615 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-cf97ce5d-8ca0-48c6-8da5-b8430cf31faf req-a9b8be9d-9123-4f69-a9b9-233174dd08e7 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:16:59.917679 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-cf97ce5d-8ca0-48c6-8da5-b8430cf31faf req-a9b8be9d-9123-4f69-a9b9-233174dd08e7 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:16:59.931335 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-cf97ce5d-8ca0-48c6-8da5-b8430cf31faf req-a9b8be9d-9123-4f69-a9b9-233174dd08e7 service nova] Creating event network-changed:91640510-d3e4-4993-9b5c-ceecbca49523 for instance ceaebb89-9428-4490-bb2f-fe34917029df on hv-cinder-85272 Aug 10 17:16:59.935107 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-178f73c3-3c52-4e41-a160-f0b1476b8624 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868715 Aug 10 17:16:59.936052 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 164/341] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:16:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:16:59.948624 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ffc161ef-e71d-4b4a-bad7-0c7a1caad0dc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:16:59.950078 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ffc161ef-e71d-4b4a-bad7-0c7a1caad0dc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:16:59.955269 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-cf97ce5d-8ca0-48c6-8da5-b8430cf31faf req-a9b8be9d-9123-4f69-a9b9-233174dd08e7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054922 Aug 10 17:16:59.959972 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 178/342] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:17:00.029090 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ffc161ef-e71d-4b4a-bad7-0c7a1caad0dc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:00.041233 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ffc161ef-e71d-4b4a-bad7-0c7a1caad0dc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1213 microversion: 2.1 time: 0.092420 Aug 10 17:17:00.041233 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 165/343] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:16:59 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:00.109094 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b17a70fb-c0eb-40f4-b2e6-639087a982f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:00.109810 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b17a70fb-c0eb-40f4-b2e6-639087a982f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:00.128401 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b17a70fb-c0eb-40f4-b2e6-639087a982f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:00.128956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b17a70fb-c0eb-40f4-b2e6-639087a982f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:00.129404 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b17a70fb-c0eb-40f4-b2e6-639087a982f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:00.130145 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b17a70fb-c0eb-40f4-b2e6-639087a982f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:00.130651 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b17a70fb-c0eb-40f4-b2e6-639087a982f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:00.131084 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b17a70fb-c0eb-40f4-b2e6-639087a982f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:00.134437 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:00.284368 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b17a70fb-c0eb-40f4-b2e6-639087a982f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:00.292824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b17a70fb-c0eb-40f4-b2e6-639087a982f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:00.294310 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b17a70fb-c0eb-40f4-b2e6-639087a982f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:00.295522 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b17a70fb-c0eb-40f4-b2e6-639087a982f5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.190837 Aug 10 17:17:00.296885 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 179/344] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:00 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:00.388011 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-df741bae-b220-4dc3-b724-c2d6e8045f3b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:00.388835 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-df741bae-b220-4dc3-b724-c2d6e8045f3b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:00.396194 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df741bae-b220-4dc3-b724-c2d6e8045f3b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:00.396871 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df741bae-b220-4dc3-b724-c2d6e8045f3b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:00.397376 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df741bae-b220-4dc3-b724-c2d6e8045f3b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:00.398410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df741bae-b220-4dc3-b724-c2d6e8045f3b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:00.399009 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df741bae-b220-4dc3-b724-c2d6e8045f3b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:00.399435 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df741bae-b220-4dc3-b724-c2d6e8045f3b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:00.613407 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-df741bae-b220-4dc3-b724-c2d6e8045f3b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:00.623170 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-df741bae-b220-4dc3-b724-c2d6e8045f3b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.241683 Aug 10 17:17:00.623782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 166/345] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:00 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:00.650943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4539daf9-88cc-4854-a884-55ddbb71276a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:00.651897 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4539daf9-88cc-4854-a884-55ddbb71276a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:00.658121 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4539daf9-88cc-4854-a884-55ddbb71276a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:00.658648 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4539daf9-88cc-4854-a884-55ddbb71276a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:00.662957 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4539daf9-88cc-4854-a884-55ddbb71276a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:00.662957 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4539daf9-88cc-4854-a884-55ddbb71276a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:00.662957 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4539daf9-88cc-4854-a884-55ddbb71276a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:00.662957 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4539daf9-88cc-4854-a884-55ddbb71276a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:00.886641 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4539daf9-88cc-4854-a884-55ddbb71276a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:00.895003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4539daf9-88cc-4854-a884-55ddbb71276a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.248577 Aug 10 17:17:00.895587 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 180/346] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:00 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:01.057492 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-44f60abb-db80-423e-8a5d-d2e25fbb89b3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:01.058106 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-44f60abb-db80-423e-8a5d-d2e25fbb89b3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:01.066541 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-44f60abb-db80-423e-8a5d-d2e25fbb89b3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:01.068767 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-44f60abb-db80-423e-8a5d-d2e25fbb89b3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:01.068767 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-44f60abb-db80-423e-8a5d-d2e25fbb89b3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:01.068767 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-44f60abb-db80-423e-8a5d-d2e25fbb89b3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:01.069324 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-44f60abb-db80-423e-8a5d-d2e25fbb89b3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:01.069324 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-44f60abb-db80-423e-8a5d-d2e25fbb89b3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:01.151251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-44f60abb-db80-423e-8a5d-d2e25fbb89b3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:01.162194 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-44f60abb-db80-423e-8a5d-d2e25fbb89b3 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1217 microversion: 2.1 time: 0.108751 Aug 10 17:17:01.162817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 167/347] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:01 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:01.319127 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-92796474-511f-4c4c-ad89-254a6361e725 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:01.320762 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-92796474-511f-4c4c-ad89-254a6361e725 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:01.323391 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=6 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:01.328840 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92796474-511f-4c4c-ad89-254a6361e725 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:01.329360 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92796474-511f-4c4c-ad89-254a6361e725 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:01.329797 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92796474-511f-4c4c-ad89-254a6361e725 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:01.333243 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92796474-511f-4c4c-ad89-254a6361e725 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:01.333243 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92796474-511f-4c4c-ad89-254a6361e725 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:01.333243 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92796474-511f-4c4c-ad89-254a6361e725 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:01.515839 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-92796474-511f-4c4c-ad89-254a6361e725 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:01.523714 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-92796474-511f-4c4c-ad89-254a6361e725 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:01.525242 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-92796474-511f-4c4c-ad89-254a6361e725 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:01.526423 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-92796474-511f-4c4c-ad89-254a6361e725 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.211547 Aug 10 17:17:01.526977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 181/348] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:01 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:01.645708 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3564092e-a3a2-42c4-89d8-dcc36712d60e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:01.646369 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3564092e-a3a2-42c4-89d8-dcc36712d60e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:01.655116 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3564092e-a3a2-42c4-89d8-dcc36712d60e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:01.655660 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3564092e-a3a2-42c4-89d8-dcc36712d60e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:01.656099 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3564092e-a3a2-42c4-89d8-dcc36712d60e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:01.656865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3564092e-a3a2-42c4-89d8-dcc36712d60e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:01.657314 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3564092e-a3a2-42c4-89d8-dcc36712d60e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:01.657756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3564092e-a3a2-42c4-89d8-dcc36712d60e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:01.797265 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-525932768", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "adf93d4a-df17-4d5a-8dd7-051408dfa629"}], "security_groups": [{"name": "tempest-securitygroup--841635916"}], "key_name": "tempest-keypair-653254705", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:01.799644 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3564092e-a3a2-42c4-89d8-dcc36712d60e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:01.808004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3564092e-a3a2-42c4-89d8-dcc36712d60e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.166480 Aug 10 17:17:01.808824 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 168/349] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:01 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:01.909234 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] validate_networks() for [('adf93d4a-df17-4d5a-8dd7-051408dfa629', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:17:01.920704 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7182e749-0e16-44b4-80f8-7729c4d6e33e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:01.920704 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7182e749-0e16-44b4-80f8-7729c4d6e33e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:01.926075 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7182e749-0e16-44b4-80f8-7729c4d6e33e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:01.926667 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7182e749-0e16-44b4-80f8-7729c4d6e33e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:01.927176 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7182e749-0e16-44b4-80f8-7729c4d6e33e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:01.927949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7182e749-0e16-44b4-80f8-7729c4d6e33e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:01.928945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7182e749-0e16-44b4-80f8-7729c4d6e33e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:01.929858 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7182e749-0e16-44b4-80f8-7729c4d6e33e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:02.126541 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7182e749-0e16-44b4-80f8-7729c4d6e33e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:02.135555 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7182e749-0e16-44b4-80f8-7729c4d6e33e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.223091 Aug 10 17:17:02.136422 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 169/350] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:01 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:02.184447 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-858fb5f5-14ff-4a64-b163-6801f98f120e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:02.185088 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-858fb5f5-14ff-4a64-b163-6801f98f120e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:02.198879 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-858fb5f5-14ff-4a64-b163-6801f98f120e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:02.198879 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-858fb5f5-14ff-4a64-b163-6801f98f120e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:02.198879 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-858fb5f5-14ff-4a64-b163-6801f98f120e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:02.198879 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-858fb5f5-14ff-4a64-b163-6801f98f120e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:02.199994 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-858fb5f5-14ff-4a64-b163-6801f98f120e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:02.199994 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-858fb5f5-14ff-4a64-b163-6801f98f120e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:02.299373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-858fb5f5-14ff-4a64-b163-6801f98f120e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:02.308340 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-858fb5f5-14ff-4a64-b163-6801f98f120e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1217 microversion: 2.1 time: 0.127999 Aug 10 17:17:02.309004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 170/351] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:02 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:02.435573 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:17:02.436365 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:17:02.436787 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:17:02.437090 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:17:02.437511 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:17:02.447577 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:02.448105 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:02.448580 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:02.449298 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:02.449751 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:02.450173 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:02.466820 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Getting quotas for project 2eb3ea42180f4a0ca5ca3c90962fb301. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:17:02.471409 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Getting quotas for user 7d2a65984c4f42fbb18977c7345c42ce and project 2eb3ea42180f4a0ca5ca3c90962fb301. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:17:02.483763 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:17:02.486028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:17:02.549485 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c1bade95-085c-447d-a17c-0341fe2fd0ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:02.549990 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c1bade95-085c-447d-a17c-0341fe2fd0ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:02.557000 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1bade95-085c-447d-a17c-0341fe2fd0ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:02.557506 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1bade95-085c-447d-a17c-0341fe2fd0ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:02.557938 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1bade95-085c-447d-a17c-0341fe2fd0ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:02.558705 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1bade95-085c-447d-a17c-0341fe2fd0ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:02.559155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1bade95-085c-447d-a17c-0341fe2fd0ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:02.559579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1bade95-085c-447d-a17c-0341fe2fd0ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:02.580283 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:02.608118 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f16c09f9-870b-4608-9b03-7f4cab2b38df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.814970 Aug 10 17:17:02.608888 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 182/352] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:17:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:17:02.622799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6a1cb772-32c6-4080-8243-d96bfa726ab5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:02.626140 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6a1cb772-32c6-4080-8243-d96bfa726ab5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:02.715990 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6a1cb772-32c6-4080-8243-d96bfa726ab5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:02.722714 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6a1cb772-32c6-4080-8243-d96bfa726ab5 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1244 microversion: 2.1 time: 0.106070 Aug 10 17:17:02.723743 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 183/353] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:02 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1244 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:02.776965 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c1bade95-085c-447d-a17c-0341fe2fd0ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:02.791749 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c1bade95-085c-447d-a17c-0341fe2fd0ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:02.793367 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c1bade95-085c-447d-a17c-0341fe2fd0ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:02.794615 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c1bade95-085c-447d-a17c-0341fe2fd0ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.249334 Aug 10 17:17:02.810141 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 171/354] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:02 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:17:02.829274 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9c7be88b-aae1-452a-b9b2-e2bcc9477966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:02.830094 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9c7be88b-aae1-452a-b9b2-e2bcc9477966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:02.837453 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c7be88b-aae1-452a-b9b2-e2bcc9477966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:02.837997 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c7be88b-aae1-452a-b9b2-e2bcc9477966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:02.838435 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c7be88b-aae1-452a-b9b2-e2bcc9477966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:02.839161 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c7be88b-aae1-452a-b9b2-e2bcc9477966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:02.839738 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c7be88b-aae1-452a-b9b2-e2bcc9477966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:02.840371 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c7be88b-aae1-452a-b9b2-e2bcc9477966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:02.992906 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9c7be88b-aae1-452a-b9b2-e2bcc9477966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:03.000905 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9c7be88b-aae1-452a-b9b2-e2bcc9477966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.175650 Aug 10 17:17:03.002463 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 184/355] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:02 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:03.157247 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5cf2bf1b-eff6-4be3-99bc-fa190931fc86 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:03.157893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5cf2bf1b-eff6-4be3-99bc-fa190931fc86 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:03.165574 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5cf2bf1b-eff6-4be3-99bc-fa190931fc86 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:03.166066 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5cf2bf1b-eff6-4be3-99bc-fa190931fc86 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:03.166542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5cf2bf1b-eff6-4be3-99bc-fa190931fc86 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:03.167437 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5cf2bf1b-eff6-4be3-99bc-fa190931fc86 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:03.167896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5cf2bf1b-eff6-4be3-99bc-fa190931fc86 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:03.168323 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5cf2bf1b-eff6-4be3-99bc-fa190931fc86 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:03.336006 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cb71ef91-6411-4322-ba72-67e14c127571 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:03.336006 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cb71ef91-6411-4322-ba72-67e14c127571 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:03.361201 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb71ef91-6411-4322-ba72-67e14c127571 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:03.365962 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb71ef91-6411-4322-ba72-67e14c127571 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:03.367387 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb71ef91-6411-4322-ba72-67e14c127571 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:03.368736 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb71ef91-6411-4322-ba72-67e14c127571 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:03.369602 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb71ef91-6411-4322-ba72-67e14c127571 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:03.370382 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb71ef91-6411-4322-ba72-67e14c127571 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:03.460715 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cb71ef91-6411-4322-ba72-67e14c127571 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:03.463885 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5cf2bf1b-eff6-4be3-99bc-fa190931fc86 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:03.469839 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cb71ef91-6411-4322-ba72-67e14c127571 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1265 microversion: 2.1 time: 0.143538 Aug 10 17:17:03.472042 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5cf2bf1b-eff6-4be3-99bc-fa190931fc86 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.318855 Aug 10 17:17:03.473273 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 172/356] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:03 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:03.483198 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 185/357] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:03 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:03.750572 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-daa1eb71-b073-4c61-b53c-e05eb4301da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:03.751190 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-daa1eb71-b073-4c61-b53c-e05eb4301da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:03.757129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-daa1eb71-b073-4c61-b53c-e05eb4301da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:03.757809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-daa1eb71-b073-4c61-b53c-e05eb4301da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:03.758258 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-daa1eb71-b073-4c61-b53c-e05eb4301da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:03.758986 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-daa1eb71-b073-4c61-b53c-e05eb4301da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:03.759446 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-daa1eb71-b073-4c61-b53c-e05eb4301da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:03.759874 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-daa1eb71-b073-4c61-b53c-e05eb4301da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:03.817275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fb860ad4-8386-4c48-a3e4-683a43dcc6dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:03.823928 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-daa1eb71-b073-4c61-b53c-e05eb4301da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:03.827718 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fb860ad4-8386-4c48-a3e4-683a43dcc6dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:03.833237 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-daa1eb71-b073-4c61-b53c-e05eb4301da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1248 microversion: 2.1 time: 0.086421 Aug 10 17:17:03.833413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb860ad4-8386-4c48-a3e4-683a43dcc6dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:03.834262 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb860ad4-8386-4c48-a3e4-683a43dcc6dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:03.834393 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 173/358] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:03 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1248 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:03.834500 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb860ad4-8386-4c48-a3e4-683a43dcc6dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:03.835791 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb860ad4-8386-4c48-a3e4-683a43dcc6dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:03.836426 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb860ad4-8386-4c48-a3e4-683a43dcc6dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:03.836861 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb860ad4-8386-4c48-a3e4-683a43dcc6dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:03.980099 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fb860ad4-8386-4c48-a3e4-683a43dcc6dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:03.988386 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fb860ad4-8386-4c48-a3e4-683a43dcc6dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:03.989893 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fb860ad4-8386-4c48-a3e4-683a43dcc6dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:03.991096 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fb860ad4-8386-4c48-a3e4-683a43dcc6dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.177847 Aug 10 17:17:03.991712 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 186/359] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:03 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:04.023230 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-de913913-03b8-408a-ad84-f1fa70bcc64a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:04.028033 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-de913913-03b8-408a-ad84-f1fa70bcc64a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:04.029821 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-de913913-03b8-408a-ad84-f1fa70bcc64a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:04.030305 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-de913913-03b8-408a-ad84-f1fa70bcc64a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:04.031701 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-de913913-03b8-408a-ad84-f1fa70bcc64a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:04.032469 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-de913913-03b8-408a-ad84-f1fa70bcc64a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:04.032939 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-de913913-03b8-408a-ad84-f1fa70bcc64a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:04.033438 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-de913913-03b8-408a-ad84-f1fa70bcc64a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:04.177973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-de913913-03b8-408a-ad84-f1fa70bcc64a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:04.186436 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-de913913-03b8-408a-ad84-f1fa70bcc64a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.167552 Aug 10 17:17:04.187015 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 174/360] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:04 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:04.490983 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-08c9c2de-65be-45dd-b0f8-a9974a262202 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:04.491736 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-08c9c2de-65be-45dd-b0f8-a9974a262202 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:04.493357 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a55ee387-e46c-48e8-b1c1-ef55ff2409f2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:04.494047 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a55ee387-e46c-48e8-b1c1-ef55ff2409f2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:04.500322 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08c9c2de-65be-45dd-b0f8-a9974a262202 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:04.500514 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a55ee387-e46c-48e8-b1c1-ef55ff2409f2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:04.501104 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a55ee387-e46c-48e8-b1c1-ef55ff2409f2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:04.503205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08c9c2de-65be-45dd-b0f8-a9974a262202 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:04.503309 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a55ee387-e46c-48e8-b1c1-ef55ff2409f2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:04.503390 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08c9c2de-65be-45dd-b0f8-a9974a262202 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:04.503467 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a55ee387-e46c-48e8-b1c1-ef55ff2409f2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:04.503542 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08c9c2de-65be-45dd-b0f8-a9974a262202 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:04.503654 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a55ee387-e46c-48e8-b1c1-ef55ff2409f2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:04.503847 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a55ee387-e46c-48e8-b1c1-ef55ff2409f2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:04.504183 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08c9c2de-65be-45dd-b0f8-a9974a262202 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:04.504954 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08c9c2de-65be-45dd-b0f8-a9974a262202 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:04.596280 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-08c9c2de-65be-45dd-b0f8-a9974a262202 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:04.605715 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-08c9c2de-65be-45dd-b0f8-a9974a262202 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1273 microversion: 2.1 time: 0.118776 Aug 10 17:17:04.607746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 187/361] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:04 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:04.668715 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a55ee387-e46c-48e8-b1c1-ef55ff2409f2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:04.677315 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a55ee387-e46c-48e8-b1c1-ef55ff2409f2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.187648 Aug 10 17:17:04.678013 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 175/362] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:04 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:04.855971 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b2de0283-f0ab-424c-ba17-e96c4f9a2475 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:04.856611 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b2de0283-f0ab-424c-ba17-e96c4f9a2475 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:04.863001 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2de0283-f0ab-424c-ba17-e96c4f9a2475 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:04.863635 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2de0283-f0ab-424c-ba17-e96c4f9a2475 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:04.864137 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2de0283-f0ab-424c-ba17-e96c4f9a2475 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:04.864965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2de0283-f0ab-424c-ba17-e96c4f9a2475 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:04.865550 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2de0283-f0ab-424c-ba17-e96c4f9a2475 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:04.866817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2de0283-f0ab-424c-ba17-e96c4f9a2475 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:04.936881 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b2de0283-f0ab-424c-ba17-e96c4f9a2475 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:04.945785 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b2de0283-f0ab-424c-ba17-e96c4f9a2475 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1240 microversion: 2.1 time: 0.093610 Aug 10 17:17:04.946395 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 188/363] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:04 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:05.015213 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-15a7420c-530a-457f-9997-d76ab1152974 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:05.015827 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-15a7420c-530a-457f-9997-d76ab1152974 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:05.021789 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-15a7420c-530a-457f-9997-d76ab1152974 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:05.022272 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-15a7420c-530a-457f-9997-d76ab1152974 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:05.023420 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-15a7420c-530a-457f-9997-d76ab1152974 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:05.024267 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-15a7420c-530a-457f-9997-d76ab1152974 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:05.024724 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-15a7420c-530a-457f-9997-d76ab1152974 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:05.025147 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-15a7420c-530a-457f-9997-d76ab1152974 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:05.158697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-15a7420c-530a-457f-9997-d76ab1152974 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:05.167462 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-15a7420c-530a-457f-9997-d76ab1152974 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:05.169224 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-15a7420c-530a-457f-9997-d76ab1152974 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:05.189666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-15a7420c-530a-457f-9997-d76ab1152974 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.159444 Aug 10 17:17:05.189666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 176/364] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:05 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:05.206492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-17045468-e732-4ee1-84f7-c96a98df88a9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:05.207133 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-17045468-e732-4ee1-84f7-c96a98df88a9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:05.213010 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17045468-e732-4ee1-84f7-c96a98df88a9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:05.213489 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17045468-e732-4ee1-84f7-c96a98df88a9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:05.213923 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17045468-e732-4ee1-84f7-c96a98df88a9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:05.214635 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17045468-e732-4ee1-84f7-c96a98df88a9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:05.215085 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17045468-e732-4ee1-84f7-c96a98df88a9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:05.215507 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17045468-e732-4ee1-84f7-c96a98df88a9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:05.355873 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-17045468-e732-4ee1-84f7-c96a98df88a9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:05.363945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-17045468-e732-4ee1-84f7-c96a98df88a9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.161270 Aug 10 17:17:05.364547 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 189/365] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:05 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:05.627713 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ca79e86a-151f-4a36-b57e-1cebbdbdfbc9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:05.628333 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ca79e86a-151f-4a36-b57e-1cebbdbdfbc9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:05.635399 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca79e86a-151f-4a36-b57e-1cebbdbdfbc9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:05.635896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca79e86a-151f-4a36-b57e-1cebbdbdfbc9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:05.636594 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca79e86a-151f-4a36-b57e-1cebbdbdfbc9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:05.637328 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca79e86a-151f-4a36-b57e-1cebbdbdfbc9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:05.637973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca79e86a-151f-4a36-b57e-1cebbdbdfbc9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:05.638429 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca79e86a-151f-4a36-b57e-1cebbdbdfbc9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:05.700573 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4a895936-b76f-43e8-9734-a7912171aa6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:05.701194 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4a895936-b76f-43e8-9734-a7912171aa6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:05.704381 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ca79e86a-151f-4a36-b57e-1cebbdbdfbc9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:05.712814 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ca79e86a-151f-4a36-b57e-1cebbdbdfbc9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1273 microversion: 2.1 time: 0.089007 Aug 10 17:17:05.722375 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 177/366] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:05 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:05.722583 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a895936-b76f-43e8-9734-a7912171aa6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:05.722583 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a895936-b76f-43e8-9734-a7912171aa6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:05.722583 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a895936-b76f-43e8-9734-a7912171aa6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:05.722583 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a895936-b76f-43e8-9734-a7912171aa6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:05.742025 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a895936-b76f-43e8-9734-a7912171aa6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:05.742025 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a895936-b76f-43e8-9734-a7912171aa6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:05.981569 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ad532a97-a16d-4ff1-bd7e-3ff28c171817 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:05.982520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ad532a97-a16d-4ff1-bd7e-3ff28c171817 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:05.989240 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad532a97-a16d-4ff1-bd7e-3ff28c171817 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:05.989732 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad532a97-a16d-4ff1-bd7e-3ff28c171817 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:05.990587 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad532a97-a16d-4ff1-bd7e-3ff28c171817 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:05.991805 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad532a97-a16d-4ff1-bd7e-3ff28c171817 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:05.992514 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad532a97-a16d-4ff1-bd7e-3ff28c171817 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:05.992944 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad532a97-a16d-4ff1-bd7e-3ff28c171817 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:06.066741 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ad532a97-a16d-4ff1-bd7e-3ff28c171817 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:06.075861 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ad532a97-a16d-4ff1-bd7e-3ff28c171817 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1296 microversion: 2.1 time: 0.098621 Aug 10 17:17:06.076445 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 178/367] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:05 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1296 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:06.131583 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4a895936-b76f-43e8-9734-a7912171aa6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:06.140412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4a895936-b76f-43e8-9734-a7912171aa6d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.443670 Aug 10 17:17:06.143170 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 190/368] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:05 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:06.195031 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5500b457-258b-413f-b092-87e457119c63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:06.195778 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5500b457-258b-413f-b092-87e457119c63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:06.202501 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5500b457-258b-413f-b092-87e457119c63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:06.202986 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5500b457-258b-413f-b092-87e457119c63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:06.203442 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5500b457-258b-413f-b092-87e457119c63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:06.204119 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5500b457-258b-413f-b092-87e457119c63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:06.204572 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5500b457-258b-413f-b092-87e457119c63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:06.204996 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5500b457-258b-413f-b092-87e457119c63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:06.352776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5500b457-258b-413f-b092-87e457119c63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:06.361626 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5500b457-258b-413f-b092-87e457119c63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:06.363430 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5500b457-258b-413f-b092-87e457119c63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:06.364445 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5500b457-258b-413f-b092-87e457119c63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.173982 Aug 10 17:17:06.365003 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 179/369] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:06 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:06.386768 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cf40212a-62ed-40e4-808c-ff8fc911dafd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:06.387611 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cf40212a-62ed-40e4-808c-ff8fc911dafd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:06.393887 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf40212a-62ed-40e4-808c-ff8fc911dafd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:06.394406 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf40212a-62ed-40e4-808c-ff8fc911dafd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:06.394854 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf40212a-62ed-40e4-808c-ff8fc911dafd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:06.395596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf40212a-62ed-40e4-808c-ff8fc911dafd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:06.396056 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf40212a-62ed-40e4-808c-ff8fc911dafd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:06.400624 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf40212a-62ed-40e4-808c-ff8fc911dafd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:06.539531 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cf40212a-62ed-40e4-808c-ff8fc911dafd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:06.546976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cf40212a-62ed-40e4-808c-ff8fc911dafd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.165119 Aug 10 17:17:06.547543 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 191/370] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:06 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:06.734010 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6da340d4-0873-4d3c-ba5b-abf19a738d02 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:06.734666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6da340d4-0873-4d3c-ba5b-abf19a738d02 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:06.740666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6da340d4-0873-4d3c-ba5b-abf19a738d02 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:06.741152 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6da340d4-0873-4d3c-ba5b-abf19a738d02 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:06.742326 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6da340d4-0873-4d3c-ba5b-abf19a738d02 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:06.743048 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6da340d4-0873-4d3c-ba5b-abf19a738d02 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:06.743505 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6da340d4-0873-4d3c-ba5b-abf19a738d02 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:06.743931 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6da340d4-0873-4d3c-ba5b-abf19a738d02 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:06.881447 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6da340d4-0873-4d3c-ba5b-abf19a738d02 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:06.890067 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6da340d4-0873-4d3c-ba5b-abf19a738d02 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.160721 Aug 10 17:17:06.890664 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 180/371] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:06 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:07.097396 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5ecef922-a8e9-4c9a-aee5-f8c441d5b05d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:07.098015 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5ecef922-a8e9-4c9a-aee5-f8c441d5b05d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:07.105089 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ecef922-a8e9-4c9a-aee5-f8c441d5b05d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:07.105576 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ecef922-a8e9-4c9a-aee5-f8c441d5b05d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:07.106010 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ecef922-a8e9-4c9a-aee5-f8c441d5b05d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:07.106733 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ecef922-a8e9-4c9a-aee5-f8c441d5b05d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:07.107195 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ecef922-a8e9-4c9a-aee5-f8c441d5b05d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:07.107622 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ecef922-a8e9-4c9a-aee5-f8c441d5b05d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:07.164363 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-69cd88aa-910d-4977-825b-b8723a48418e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:07.164993 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-69cd88aa-910d-4977-825b-b8723a48418e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:07.170312 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5ecef922-a8e9-4c9a-aee5-f8c441d5b05d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:07.171606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69cd88aa-910d-4977-825b-b8723a48418e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:07.172092 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69cd88aa-910d-4977-825b-b8723a48418e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:07.172526 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69cd88aa-910d-4977-825b-b8723a48418e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:07.173215 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69cd88aa-910d-4977-825b-b8723a48418e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:07.173668 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69cd88aa-910d-4977-825b-b8723a48418e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:07.174089 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69cd88aa-910d-4977-825b-b8723a48418e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:07.177917 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5ecef922-a8e9-4c9a-aee5-f8c441d5b05d tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1296 microversion: 2.1 time: 0.084438 Aug 10 17:17:07.178522 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 192/372] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:07 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:07.307563 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-69cd88aa-910d-4977-825b-b8723a48418e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:07.315917 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-69cd88aa-910d-4977-825b-b8723a48418e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.156007 Aug 10 17:17:07.316682 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 181/373] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:07 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:07.387916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-240f7420-7f27-4015-83a1-ab3ec5daef25 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:07.388446 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-240f7420-7f27-4015-83a1-ab3ec5daef25 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:07.394497 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-240f7420-7f27-4015-83a1-ab3ec5daef25 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:07.394989 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-240f7420-7f27-4015-83a1-ab3ec5daef25 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:07.395429 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-240f7420-7f27-4015-83a1-ab3ec5daef25 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:07.396127 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-240f7420-7f27-4015-83a1-ab3ec5daef25 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:07.396586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-240f7420-7f27-4015-83a1-ab3ec5daef25 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:07.397009 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-240f7420-7f27-4015-83a1-ab3ec5daef25 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:07.535507 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-240f7420-7f27-4015-83a1-ab3ec5daef25 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:07.545689 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-240f7420-7f27-4015-83a1-ab3ec5daef25 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:07.547362 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-240f7420-7f27-4015-83a1-ab3ec5daef25 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:07.548557 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-240f7420-7f27-4015-83a1-ab3ec5daef25 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.164982 Aug 10 17:17:07.549123 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 193/374] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:07 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:07.572757 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-30db0a65-281e-4e5d-aef6-8cc2b2a7d166 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:07.573899 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-30db0a65-281e-4e5d-aef6-8cc2b2a7d166 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:07.584536 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30db0a65-281e-4e5d-aef6-8cc2b2a7d166 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:07.585257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30db0a65-281e-4e5d-aef6-8cc2b2a7d166 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:07.586324 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30db0a65-281e-4e5d-aef6-8cc2b2a7d166 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:07.587166 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30db0a65-281e-4e5d-aef6-8cc2b2a7d166 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:07.587725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30db0a65-281e-4e5d-aef6-8cc2b2a7d166 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:07.588347 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30db0a65-281e-4e5d-aef6-8cc2b2a7d166 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:07.725236 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-30db0a65-281e-4e5d-aef6-8cc2b2a7d166 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:07.732938 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-30db0a65-281e-4e5d-aef6-8cc2b2a7d166 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.168059 Aug 10 17:17:07.733512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 182/375] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:07 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:07.911285 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c3614b60-bdcd-4ef2-a0c2-fbedc82ef15c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:07.911823 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c3614b60-bdcd-4ef2-a0c2-fbedc82ef15c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:07.917957 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3614b60-bdcd-4ef2-a0c2-fbedc82ef15c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:07.918484 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3614b60-bdcd-4ef2-a0c2-fbedc82ef15c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:07.918931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3614b60-bdcd-4ef2-a0c2-fbedc82ef15c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:07.919623 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3614b60-bdcd-4ef2-a0c2-fbedc82ef15c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:07.920079 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3614b60-bdcd-4ef2-a0c2-fbedc82ef15c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:07.920511 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3614b60-bdcd-4ef2-a0c2-fbedc82ef15c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:08.092009 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c3614b60-bdcd-4ef2-a0c2-fbedc82ef15c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:08.099632 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c3614b60-bdcd-4ef2-a0c2-fbedc82ef15c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.192401 Aug 10 17:17:08.100291 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 194/376] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:07 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:08.198605 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-40c5168c-f39b-474e-918b-d5ec7b8105bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:08.199144 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-40c5168c-f39b-474e-918b-d5ec7b8105bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:08.205892 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40c5168c-f39b-474e-918b-d5ec7b8105bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:08.206404 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40c5168c-f39b-474e-918b-d5ec7b8105bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:08.206848 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40c5168c-f39b-474e-918b-d5ec7b8105bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:08.207551 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40c5168c-f39b-474e-918b-d5ec7b8105bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:08.208010 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40c5168c-f39b-474e-918b-d5ec7b8105bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:08.208439 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40c5168c-f39b-474e-918b-d5ec7b8105bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:08.273440 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-40c5168c-f39b-474e-918b-d5ec7b8105bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:08.281534 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-40c5168c-f39b-474e-918b-d5ec7b8105bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1296 microversion: 2.1 time: 0.086915 Aug 10 17:17:08.282126 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 183/377] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:08 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:08.337775 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d7e56670-1992-4662-a891-6a4d594ebdd6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:08.338465 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d7e56670-1992-4662-a891-6a4d594ebdd6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:08.344831 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7e56670-1992-4662-a891-6a4d594ebdd6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:08.345316 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7e56670-1992-4662-a891-6a4d594ebdd6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:08.345752 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7e56670-1992-4662-a891-6a4d594ebdd6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:08.346559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7e56670-1992-4662-a891-6a4d594ebdd6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:08.347024 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7e56670-1992-4662-a891-6a4d594ebdd6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:08.347451 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7e56670-1992-4662-a891-6a4d594ebdd6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:08.484580 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d7e56670-1992-4662-a891-6a4d594ebdd6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:08.492871 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d7e56670-1992-4662-a891-6a4d594ebdd6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.158953 Aug 10 17:17:08.493510 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 195/378] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:08 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:08.572005 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ca9c169d-c356-4a5c-8e00-bcd8cd139c55 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:08.572624 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ca9c169d-c356-4a5c-8e00-bcd8cd139c55 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:08.578678 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca9c169d-c356-4a5c-8e00-bcd8cd139c55 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:08.579163 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca9c169d-c356-4a5c-8e00-bcd8cd139c55 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:08.579652 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca9c169d-c356-4a5c-8e00-bcd8cd139c55 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:08.580341 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca9c169d-c356-4a5c-8e00-bcd8cd139c55 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:08.580803 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca9c169d-c356-4a5c-8e00-bcd8cd139c55 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:08.581228 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca9c169d-c356-4a5c-8e00-bcd8cd139c55 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:08.715283 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ca9c169d-c356-4a5c-8e00-bcd8cd139c55 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:08.723365 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ca9c169d-c356-4a5c-8e00-bcd8cd139c55 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:08.724856 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ca9c169d-c356-4a5c-8e00-bcd8cd139c55 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:08.726022 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ca9c169d-c356-4a5c-8e00-bcd8cd139c55 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.158121 Aug 10 17:17:08.726604 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 184/379] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:08 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:08.753105 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-afcd896d-d13f-4338-ab94-88dba82f6e45 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:08.753714 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-afcd896d-d13f-4338-ab94-88dba82f6e45 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:08.761712 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afcd896d-d13f-4338-ab94-88dba82f6e45 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:08.762205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afcd896d-d13f-4338-ab94-88dba82f6e45 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:08.762683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afcd896d-d13f-4338-ab94-88dba82f6e45 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:08.763477 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afcd896d-d13f-4338-ab94-88dba82f6e45 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:08.764639 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afcd896d-d13f-4338-ab94-88dba82f6e45 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:08.765130 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afcd896d-d13f-4338-ab94-88dba82f6e45 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:08.905854 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-afcd896d-d13f-4338-ab94-88dba82f6e45 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:08.913999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-afcd896d-d13f-4338-ab94-88dba82f6e45 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.164080 Aug 10 17:17:08.914611 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 196/380] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:08 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:09.121864 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-db986f03-59ec-4b8f-8e69-8e323cbb7df9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:09.122507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-db986f03-59ec-4b8f-8e69-8e323cbb7df9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:09.128525 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-db986f03-59ec-4b8f-8e69-8e323cbb7df9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:09.129010 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-db986f03-59ec-4b8f-8e69-8e323cbb7df9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:09.129451 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-db986f03-59ec-4b8f-8e69-8e323cbb7df9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:09.130208 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-db986f03-59ec-4b8f-8e69-8e323cbb7df9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:09.130700 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-db986f03-59ec-4b8f-8e69-8e323cbb7df9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:09.131125 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-db986f03-59ec-4b8f-8e69-8e323cbb7df9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:09.263552 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-db986f03-59ec-4b8f-8e69-8e323cbb7df9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:09.272208 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-db986f03-59ec-4b8f-8e69-8e323cbb7df9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.154083 Aug 10 17:17:09.273307 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 185/381] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:09 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:09.302381 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c753449a-9211-4571-af13-c39296c46725 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:09.303022 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c753449a-9211-4571-af13-c39296c46725 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:09.308899 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c753449a-9211-4571-af13-c39296c46725 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:09.309373 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c753449a-9211-4571-af13-c39296c46725 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:09.309829 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c753449a-9211-4571-af13-c39296c46725 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:09.310545 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c753449a-9211-4571-af13-c39296c46725 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:09.310997 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c753449a-9211-4571-af13-c39296c46725 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:09.311417 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c753449a-9211-4571-af13-c39296c46725 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:09.325936 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:09.375872 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c753449a-9211-4571-af13-c39296c46725 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:09.383534 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c753449a-9211-4571-af13-c39296c46725 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1296 microversion: 2.1 time: 0.084895 Aug 10 17:17:09.384110 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 197/382] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:09 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:09.519288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e0ba4201-dc9f-4889-8f7a-af392ff6f6fd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:09.520044 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e0ba4201-dc9f-4889-8f7a-af392ff6f6fd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:09.527790 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0ba4201-dc9f-4889-8f7a-af392ff6f6fd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:09.528657 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0ba4201-dc9f-4889-8f7a-af392ff6f6fd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:09.529180 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0ba4201-dc9f-4889-8f7a-af392ff6f6fd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:09.533536 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0ba4201-dc9f-4889-8f7a-af392ff6f6fd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:09.533536 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0ba4201-dc9f-4889-8f7a-af392ff6f6fd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:09.533536 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0ba4201-dc9f-4889-8f7a-af392ff6f6fd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:09.698045 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e0ba4201-dc9f-4889-8f7a-af392ff6f6fd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:09.709775 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e0ba4201-dc9f-4889-8f7a-af392ff6f6fd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.197801 Aug 10 17:17:09.712373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 186/383] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:09 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:09.748767 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-41d2112f-d175-47c4-93d4-e77d8c1357ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:09.749384 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-41d2112f-d175-47c4-93d4-e77d8c1357ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:09.758722 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41d2112f-d175-47c4-93d4-e77d8c1357ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:09.779090 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41d2112f-d175-47c4-93d4-e77d8c1357ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:09.779090 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41d2112f-d175-47c4-93d4-e77d8c1357ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:09.779090 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41d2112f-d175-47c4-93d4-e77d8c1357ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:09.779090 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41d2112f-d175-47c4-93d4-e77d8c1357ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:09.779427 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41d2112f-d175-47c4-93d4-e77d8c1357ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:09.931874 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-41d2112f-d175-47c4-93d4-e77d8c1357ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:09.942621 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-41d2112f-d175-47c4-93d4-e77d8c1357ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:09.944206 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0b5b5e4d-2be3-468c-8b24-db4251669bbb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:09.945054 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-41d2112f-d175-47c4-93d4-e77d8c1357ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:09.945242 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0b5b5e4d-2be3-468c-8b24-db4251669bbb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:09.946232 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-41d2112f-d175-47c4-93d4-e77d8c1357ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.201451 Aug 10 17:17:09.947158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 198/384] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:09 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:09.948083 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=4 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:09.956913 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b5b5e4d-2be3-468c-8b24-db4251669bbb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:09.957423 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b5b5e4d-2be3-468c-8b24-db4251669bbb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:09.957863 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b5b5e4d-2be3-468c-8b24-db4251669bbb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:09.958600 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b5b5e4d-2be3-468c-8b24-db4251669bbb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:09.959595 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b5b5e4d-2be3-468c-8b24-db4251669bbb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:09.962863 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b5b5e4d-2be3-468c-8b24-db4251669bbb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:10.033459 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=22 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:10.246941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0b5b5e4d-2be3-468c-8b24-db4251669bbb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:10.254905 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0b5b5e4d-2be3-468c-8b24-db4251669bbb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.320865 Aug 10 17:17:10.261470 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 187/385] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:09 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:10.295943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-de618b8c-9453-43d9-a7aa-d4b661d6eddf tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:10.296648 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-de618b8c-9453-43d9-a7aa-d4b661d6eddf tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:10.304172 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de618b8c-9453-43d9-a7aa-d4b661d6eddf tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:10.305160 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de618b8c-9453-43d9-a7aa-d4b661d6eddf tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:10.305682 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de618b8c-9453-43d9-a7aa-d4b661d6eddf tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:10.307257 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de618b8c-9453-43d9-a7aa-d4b661d6eddf tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:10.307766 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de618b8c-9453-43d9-a7aa-d4b661d6eddf tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:10.309302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de618b8c-9453-43d9-a7aa-d4b661d6eddf tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:10.404846 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-31b90754-e737-4eb1-a7ab-583be32b1842 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:10.405536 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-31b90754-e737-4eb1-a7ab-583be32b1842 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:10.412001 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-31b90754-e737-4eb1-a7ab-583be32b1842 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:10.412563 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-31b90754-e737-4eb1-a7ab-583be32b1842 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:10.415681 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-31b90754-e737-4eb1-a7ab-583be32b1842 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:10.415681 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-31b90754-e737-4eb1-a7ab-583be32b1842 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:10.415681 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-31b90754-e737-4eb1-a7ab-583be32b1842 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:10.415681 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-31b90754-e737-4eb1-a7ab-583be32b1842 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:10.420751 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:10.523173 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-31b90754-e737-4eb1-a7ab-583be32b1842 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:10.535648 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-31b90754-e737-4eb1-a7ab-583be32b1842 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1302 microversion: 2.1 time: 0.133811 Aug 10 17:17:10.551750 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 188/386] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:10 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1302 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:10.579577 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-de618b8c-9453-43d9-a7aa-d4b661d6eddf tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:10.587518 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-de618b8c-9453-43d9-a7aa-d4b661d6eddf tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.297444 Aug 10 17:17:10.588335 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 199/387] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:10 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:10.734313 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5f3c08ef-2c5d-47d6-ac90-ac920df8147a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:10.734985 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5f3c08ef-2c5d-47d6-ac90-ac920df8147a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:10.741398 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f3c08ef-2c5d-47d6-ac90-ac920df8147a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:10.742602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f3c08ef-2c5d-47d6-ac90-ac920df8147a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:10.743019 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f3c08ef-2c5d-47d6-ac90-ac920df8147a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:10.743752 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f3c08ef-2c5d-47d6-ac90-ac920df8147a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:10.744186 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f3c08ef-2c5d-47d6-ac90-ac920df8147a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:10.744687 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f3c08ef-2c5d-47d6-ac90-ac920df8147a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:10.825625 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-b0e0717a-149a-46bd-97fe-44b6c467351c req-fea50b50-9525-4cbd-aef9-2754cb083337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b896ebbd-8a0c-4729-98e4-e27e38e70856", "tag": "8231cc59-a495-4ec2-b108-a116409f6427"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:10.856414 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b0e0717a-149a-46bd-97fe-44b6c467351c req-fea50b50-9525-4cbd-aef9-2754cb083337 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:10.857701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b0e0717a-149a-46bd-97fe-44b6c467351c req-fea50b50-9525-4cbd-aef9-2754cb083337 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:10.859325 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b0e0717a-149a-46bd-97fe-44b6c467351c req-fea50b50-9525-4cbd-aef9-2754cb083337 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:10.879252 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-b0e0717a-149a-46bd-97fe-44b6c467351c req-fea50b50-9525-4cbd-aef9-2754cb083337 service nova] Creating event network-changed:8231cc59-a495-4ec2-b108-a116409f6427 for instance b896ebbd-8a0c-4729-98e4-e27e38e70856 on hv-cinder-85272 Aug 10 17:17:10.885475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-b0e0717a-149a-46bd-97fe-44b6c467351c req-fea50b50-9525-4cbd-aef9-2754cb083337 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075799 Aug 10 17:17:10.886947 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 200/388] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:17:10.975501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9ef89603-227d-4282-b526-8fd984bb4e11 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:10.976678 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9ef89603-227d-4282-b526-8fd984bb4e11 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:10.983935 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ef89603-227d-4282-b526-8fd984bb4e11 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:10.984576 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ef89603-227d-4282-b526-8fd984bb4e11 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:10.985042 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ef89603-227d-4282-b526-8fd984bb4e11 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:10.985804 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ef89603-227d-4282-b526-8fd984bb4e11 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:10.986469 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ef89603-227d-4282-b526-8fd984bb4e11 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:10.986893 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ef89603-227d-4282-b526-8fd984bb4e11 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:11.026187 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5f3c08ef-2c5d-47d6-ac90-ac920df8147a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:11.034910 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5f3c08ef-2c5d-47d6-ac90-ac920df8147a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.305363 Aug 10 17:17:11.045656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 189/389] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:10 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:11.144427 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9ef89603-227d-4282-b526-8fd984bb4e11 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:11.153668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9ef89603-227d-4282-b526-8fd984bb4e11 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:11.155204 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9ef89603-227d-4282-b526-8fd984bb4e11 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:11.156484 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9ef89603-227d-4282-b526-8fd984bb4e11 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.188462 Aug 10 17:17:11.157241 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 201/390] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:10 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:17:11.278770 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1105e289-1ad1-40b5-b41c-bd8c286d5ba9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:11.279696 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1105e289-1ad1-40b5-b41c-bd8c286d5ba9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:11.286664 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1105e289-1ad1-40b5-b41c-bd8c286d5ba9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:11.287163 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1105e289-1ad1-40b5-b41c-bd8c286d5ba9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:11.287597 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1105e289-1ad1-40b5-b41c-bd8c286d5ba9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:11.289143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1105e289-1ad1-40b5-b41c-bd8c286d5ba9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:11.289624 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1105e289-1ad1-40b5-b41c-bd8c286d5ba9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:11.290065 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1105e289-1ad1-40b5-b41c-bd8c286d5ba9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:11.500183 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1105e289-1ad1-40b5-b41c-bd8c286d5ba9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:11.510710 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1105e289-1ad1-40b5-b41c-bd8c286d5ba9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.237760 Aug 10 17:17:11.511823 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 190/391] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:11 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:11.558707 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4175725b-0d28-4e59-bf67-07dbd7253300 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:11.559448 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4175725b-0d28-4e59-bf67-07dbd7253300 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:11.566283 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4175725b-0d28-4e59-bf67-07dbd7253300 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:11.569618 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4175725b-0d28-4e59-bf67-07dbd7253300 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:11.569618 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4175725b-0d28-4e59-bf67-07dbd7253300 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:11.569618 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4175725b-0d28-4e59-bf67-07dbd7253300 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:11.569618 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4175725b-0d28-4e59-bf67-07dbd7253300 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:11.570257 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4175725b-0d28-4e59-bf67-07dbd7253300 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:11.608979 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d21b1425-01e7-48e3-b5a1-e349b34d6f66 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:11.609598 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d21b1425-01e7-48e3-b5a1-e349b34d6f66 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:11.629522 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d21b1425-01e7-48e3-b5a1-e349b34d6f66 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:11.639301 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d21b1425-01e7-48e3-b5a1-e349b34d6f66 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:11.639756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d21b1425-01e7-48e3-b5a1-e349b34d6f66 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:11.640496 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d21b1425-01e7-48e3-b5a1-e349b34d6f66 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:11.640953 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d21b1425-01e7-48e3-b5a1-e349b34d6f66 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:11.641395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d21b1425-01e7-48e3-b5a1-e349b34d6f66 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:11.678061 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4175725b-0d28-4e59-bf67-07dbd7253300 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:11.690068 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4175725b-0d28-4e59-bf67-07dbd7253300 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1302 microversion: 2.1 time: 0.136691 Aug 10 17:17:11.690691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 202/392] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:11 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1302 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:11.753001 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-33e38642-a8cd-4420-858b-493bfda7ec7f req-32cb62dc-232f-4dce-a5e7-f291a51a53c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceaebb89-9428-4490-bb2f-fe34917029df", "name": "network-vif-plugged", "status": "completed", "tag": "91640510-d3e4-4993-9b5c-ceecbca49523"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:11.768083 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-33e38642-a8cd-4420-858b-493bfda7ec7f req-32cb62dc-232f-4dce-a5e7-f291a51a53c4 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:11.769100 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-33e38642-a8cd-4420-858b-493bfda7ec7f req-32cb62dc-232f-4dce-a5e7-f291a51a53c4 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:11.769774 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-33e38642-a8cd-4420-858b-493bfda7ec7f req-32cb62dc-232f-4dce-a5e7-f291a51a53c4 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:11.792668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-33e38642-a8cd-4420-858b-493bfda7ec7f req-32cb62dc-232f-4dce-a5e7-f291a51a53c4 service nova] Creating event network-vif-plugged:91640510-d3e4-4993-9b5c-ceecbca49523 for instance ceaebb89-9428-4490-bb2f-fe34917029df on hv-cinder-85272 Aug 10 17:17:11.797960 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-33e38642-a8cd-4420-858b-493bfda7ec7f req-32cb62dc-232f-4dce-a5e7-f291a51a53c4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050324 Aug 10 17:17:11.798657 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 203/393] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:17:11.845553 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d21b1425-01e7-48e3-b5a1-e349b34d6f66 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:11.855573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d21b1425-01e7-48e3-b5a1-e349b34d6f66 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.250190 Aug 10 17:17:11.856424 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 191/394] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:11 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:12.058467 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6044051a-ca2d-4b5a-8aaa-1a3bd9955a14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:12.059126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6044051a-ca2d-4b5a-8aaa-1a3bd9955a14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:12.063566 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:12.068959 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6044051a-ca2d-4b5a-8aaa-1a3bd9955a14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:12.070027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6044051a-ca2d-4b5a-8aaa-1a3bd9955a14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:12.070632 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6044051a-ca2d-4b5a-8aaa-1a3bd9955a14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:12.071345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6044051a-ca2d-4b5a-8aaa-1a3bd9955a14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:12.071881 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6044051a-ca2d-4b5a-8aaa-1a3bd9955a14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:12.072314 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6044051a-ca2d-4b5a-8aaa-1a3bd9955a14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:12.182672 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b82945dd-4167-4841-adb6-36b2e9d3f07e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:12.183376 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b82945dd-4167-4841-adb6-36b2e9d3f07e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:12.189915 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b82945dd-4167-4841-adb6-36b2e9d3f07e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:12.190446 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b82945dd-4167-4841-adb6-36b2e9d3f07e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:12.190884 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b82945dd-4167-4841-adb6-36b2e9d3f07e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:12.191768 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b82945dd-4167-4841-adb6-36b2e9d3f07e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:12.192390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b82945dd-4167-4841-adb6-36b2e9d3f07e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:12.192974 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b82945dd-4167-4841-adb6-36b2e9d3f07e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:12.226248 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6044051a-ca2d-4b5a-8aaa-1a3bd9955a14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:12.236961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6044051a-ca2d-4b5a-8aaa-1a3bd9955a14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.184760 Aug 10 17:17:12.237547 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 204/395] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:12 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:12.377734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b82945dd-4167-4841-adb6-36b2e9d3f07e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:12.386799 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b82945dd-4167-4841-adb6-36b2e9d3f07e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:12.390039 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b82945dd-4167-4841-adb6-36b2e9d3f07e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:12.391597 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b82945dd-4167-4841-adb6-36b2e9d3f07e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.213524 Aug 10 17:17:12.406696 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 192/396] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:12 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:17:12.534805 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b279a8af-af8d-4bd2-a8b4-c14361735501 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:12.535634 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b279a8af-af8d-4bd2-a8b4-c14361735501 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:12.538596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:12.546664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b279a8af-af8d-4bd2-a8b4-c14361735501 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:12.547159 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b279a8af-af8d-4bd2-a8b4-c14361735501 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:12.547597 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b279a8af-af8d-4bd2-a8b4-c14361735501 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:12.548416 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b279a8af-af8d-4bd2-a8b4-c14361735501 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:12.548871 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b279a8af-af8d-4bd2-a8b4-c14361735501 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:12.549486 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b279a8af-af8d-4bd2-a8b4-c14361735501 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:12.712409 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f2e57262-e5bf-4ec9-802b-2bb9f6599f8c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:12.713150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f2e57262-e5bf-4ec9-802b-2bb9f6599f8c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:12.713950 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b279a8af-af8d-4bd2-a8b4-c14361735501 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:12.720821 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2e57262-e5bf-4ec9-802b-2bb9f6599f8c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:12.721427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2e57262-e5bf-4ec9-802b-2bb9f6599f8c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:12.721785 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=8 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:12.722166 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2e57262-e5bf-4ec9-802b-2bb9f6599f8c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:12.723115 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2e57262-e5bf-4ec9-802b-2bb9f6599f8c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:12.723584 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2e57262-e5bf-4ec9-802b-2bb9f6599f8c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:12.724020 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2e57262-e5bf-4ec9-802b-2bb9f6599f8c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:12.724455 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b279a8af-af8d-4bd2-a8b4-c14361735501 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.195021 Aug 10 17:17:12.725039 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 205/397] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:12 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:12.879458 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a1913078-cb82-421c-916c-86ceeed58ecc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:12.880370 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a1913078-cb82-421c-916c-86ceeed58ecc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:12.898337 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1913078-cb82-421c-916c-86ceeed58ecc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:12.898337 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1913078-cb82-421c-916c-86ceeed58ecc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:12.898337 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1913078-cb82-421c-916c-86ceeed58ecc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:12.899169 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1913078-cb82-421c-916c-86ceeed58ecc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:12.900000 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1913078-cb82-421c-916c-86ceeed58ecc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:12.900748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1913078-cb82-421c-916c-86ceeed58ecc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:12.901575 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f2e57262-e5bf-4ec9-802b-2bb9f6599f8c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:12.915281 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f2e57262-e5bf-4ec9-802b-2bb9f6599f8c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.206935 Aug 10 17:17:12.927849 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 193/398] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:12 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:13.080193 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a1913078-cb82-421c-916c-86ceeed58ecc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:13.088509 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a1913078-cb82-421c-916c-86ceeed58ecc tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.215187 Aug 10 17:17:13.089092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 206/399] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:12 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:13.154547 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-e41ad547-51bb-4141-aaed-afd0a99682e4 req-fc548dec-132c-4831-8f6b-62aabceca93c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a02347-095c-4aa2-92b0-5bcdf5fce2a9", "tag": "f75a7b46-ae6b-4d8e-bf2e-f099e435733a"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:13.164665 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e41ad547-51bb-4141-aaed-afd0a99682e4 req-fc548dec-132c-4831-8f6b-62aabceca93c service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:13.165132 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e41ad547-51bb-4141-aaed-afd0a99682e4 req-fc548dec-132c-4831-8f6b-62aabceca93c service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:13.165564 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e41ad547-51bb-4141-aaed-afd0a99682e4 req-fc548dec-132c-4831-8f6b-62aabceca93c service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:13.176905 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-e41ad547-51bb-4141-aaed-afd0a99682e4 req-fc548dec-132c-4831-8f6b-62aabceca93c service nova] Creating event network-changed:f75a7b46-ae6b-4d8e-bf2e-f099e435733a for instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 on hv-cinder-85272 Aug 10 17:17:13.181832 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-e41ad547-51bb-4141-aaed-afd0a99682e4 req-fc548dec-132c-4831-8f6b-62aabceca93c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031008 Aug 10 17:17:13.182461 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 194/400] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:17:13.259684 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fcaed43b-6c27-40b8-ac46-f08583da51a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:13.260282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fcaed43b-6c27-40b8-ac46-f08583da51a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:13.266558 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcaed43b-6c27-40b8-ac46-f08583da51a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:13.267040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcaed43b-6c27-40b8-ac46-f08583da51a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:13.267473 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcaed43b-6c27-40b8-ac46-f08583da51a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:13.268156 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcaed43b-6c27-40b8-ac46-f08583da51a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:13.268607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcaed43b-6c27-40b8-ac46-f08583da51a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:13.269026 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcaed43b-6c27-40b8-ac46-f08583da51a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:13.400734 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fcaed43b-6c27-40b8-ac46-f08583da51a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:13.408876 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fcaed43b-6c27-40b8-ac46-f08583da51a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.153032 Aug 10 17:17:13.409450 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 207/401] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:13 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:13.419429 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-af6a3055-9e0a-4869-b5e0-bb8826722658 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:13.420121 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-af6a3055-9e0a-4869-b5e0-bb8826722658 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:13.426286 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-af6a3055-9e0a-4869-b5e0-bb8826722658 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:13.426814 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-af6a3055-9e0a-4869-b5e0-bb8826722658 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:13.427255 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-af6a3055-9e0a-4869-b5e0-bb8826722658 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:13.427944 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-af6a3055-9e0a-4869-b5e0-bb8826722658 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:13.428397 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-af6a3055-9e0a-4869-b5e0-bb8826722658 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:13.429147 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-af6a3055-9e0a-4869-b5e0-bb8826722658 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:13.559291 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-af6a3055-9e0a-4869-b5e0-bb8826722658 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:13.567344 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-af6a3055-9e0a-4869-b5e0-bb8826722658 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:13.568915 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-af6a3055-9e0a-4869-b5e0-bb8826722658 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:13.570865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-af6a3055-9e0a-4869-b5e0-bb8826722658 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.156214 Aug 10 17:17:13.571422 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 195/402] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:13 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:13.747608 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8e3f6c18-1e7a-419f-8a22-f874793c3167 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:13.748149 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8e3f6c18-1e7a-419f-8a22-f874793c3167 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:13.754603 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e3f6c18-1e7a-419f-8a22-f874793c3167 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:13.755070 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e3f6c18-1e7a-419f-8a22-f874793c3167 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:13.755510 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e3f6c18-1e7a-419f-8a22-f874793c3167 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:13.756200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e3f6c18-1e7a-419f-8a22-f874793c3167 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:13.756654 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e3f6c18-1e7a-419f-8a22-f874793c3167 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:13.757823 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e3f6c18-1e7a-419f-8a22-f874793c3167 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:13.894818 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8e3f6c18-1e7a-419f-8a22-f874793c3167 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:13.907434 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8e3f6c18-1e7a-419f-8a22-f874793c3167 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.159760 Aug 10 17:17:13.907434 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 208/403] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:13 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:13.950815 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ef5b5a9e-575a-4e3f-a295-19c64ff28ee3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:13.951464 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ef5b5a9e-575a-4e3f-a295-19c64ff28ee3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:13.958081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ef5b5a9e-575a-4e3f-a295-19c64ff28ee3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:13.958632 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ef5b5a9e-575a-4e3f-a295-19c64ff28ee3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:13.959104 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ef5b5a9e-575a-4e3f-a295-19c64ff28ee3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:13.960378 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ef5b5a9e-575a-4e3f-a295-19c64ff28ee3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:13.961017 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ef5b5a9e-575a-4e3f-a295-19c64ff28ee3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:13.961446 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ef5b5a9e-575a-4e3f-a295-19c64ff28ee3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:14.239598 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ef5b5a9e-575a-4e3f-a295-19c64ff28ee3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:14.239598 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ef5b5a9e-575a-4e3f-a295-19c64ff28ee3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.157965 Aug 10 17:17:14.239598 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 196/404] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:13 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:14.243810 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0deadc71-f69b-4e50-b65d-5c549273a507 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:14.243810 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0deadc71-f69b-4e50-b65d-5c549273a507 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:14.243810 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0deadc71-f69b-4e50-b65d-5c549273a507 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:14.243810 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0deadc71-f69b-4e50-b65d-5c549273a507 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:14.245110 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0deadc71-f69b-4e50-b65d-5c549273a507 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:14.245110 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0deadc71-f69b-4e50-b65d-5c549273a507 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:14.245110 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0deadc71-f69b-4e50-b65d-5c549273a507 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:14.245110 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0deadc71-f69b-4e50-b65d-5c549273a507 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:14.257779 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0deadc71-f69b-4e50-b65d-5c549273a507 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:14.265554 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0deadc71-f69b-4e50-b65d-5c549273a507 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.160072 Aug 10 17:17:14.266132 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 209/405] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:14 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:14.431546 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-85fee1c4-5a08-44e9-86d3-a7f3a8bdbbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:14.432167 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-85fee1c4-5a08-44e9-86d3-a7f3a8bdbbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:14.438956 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-85fee1c4-5a08-44e9-86d3-a7f3a8bdbbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:14.439441 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-85fee1c4-5a08-44e9-86d3-a7f3a8bdbbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:14.439876 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-85fee1c4-5a08-44e9-86d3-a7f3a8bdbbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:14.440573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-85fee1c4-5a08-44e9-86d3-a7f3a8bdbbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:14.441022 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-85fee1c4-5a08-44e9-86d3-a7f3a8bdbbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:14.441471 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-85fee1c4-5a08-44e9-86d3-a7f3a8bdbbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:14.574595 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-85fee1c4-5a08-44e9-86d3-a7f3a8bdbbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:14.582860 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-85fee1c4-5a08-44e9-86d3-a7f3a8bdbbac tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.156037 Aug 10 17:17:14.583440 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 197/406] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:14 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:14.594029 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7b719e5a-fc14-4d24-b526-27fa1855deb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:14.594651 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7b719e5a-fc14-4d24-b526-27fa1855deb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:14.601292 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b719e5a-fc14-4d24-b526-27fa1855deb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:14.602203 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b719e5a-fc14-4d24-b526-27fa1855deb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:14.602670 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b719e5a-fc14-4d24-b526-27fa1855deb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:14.603380 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b719e5a-fc14-4d24-b526-27fa1855deb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:14.603830 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b719e5a-fc14-4d24-b526-27fa1855deb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:14.604265 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b719e5a-fc14-4d24-b526-27fa1855deb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:14.743747 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7b719e5a-fc14-4d24-b526-27fa1855deb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:14.752343 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7b719e5a-fc14-4d24-b526-27fa1855deb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:14.753965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7b719e5a-fc14-4d24-b526-27fa1855deb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:14.755219 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7b719e5a-fc14-4d24-b526-27fa1855deb4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.165085 Aug 10 17:17:14.755801 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 210/407] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:14 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:14.933026 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6ef00c56-6f43-4e7a-824c-ae3ec3ce7ab1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:14.933645 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6ef00c56-6f43-4e7a-824c-ae3ec3ce7ab1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:14.939843 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6ef00c56-6f43-4e7a-824c-ae3ec3ce7ab1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:14.940337 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6ef00c56-6f43-4e7a-824c-ae3ec3ce7ab1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:14.940779 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6ef00c56-6f43-4e7a-824c-ae3ec3ce7ab1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:14.941472 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6ef00c56-6f43-4e7a-824c-ae3ec3ce7ab1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:14.941930 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6ef00c56-6f43-4e7a-824c-ae3ec3ce7ab1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:14.942383 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6ef00c56-6f43-4e7a-824c-ae3ec3ce7ab1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:15.079977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6ef00c56-6f43-4e7a-824c-ae3ec3ce7ab1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:15.087377 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6ef00c56-6f43-4e7a-824c-ae3ec3ce7ab1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.158262 Aug 10 17:17:15.087935 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 198/408] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:14 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:15.248134 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5bdb5339-4f38-4dbf-a681-2928d5de0504 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:15.248640 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5bdb5339-4f38-4dbf-a681-2928d5de0504 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:15.255288 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bdb5339-4f38-4dbf-a681-2928d5de0504 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:15.255775 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bdb5339-4f38-4dbf-a681-2928d5de0504 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:15.256213 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bdb5339-4f38-4dbf-a681-2928d5de0504 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:15.256994 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bdb5339-4f38-4dbf-a681-2928d5de0504 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:15.257453 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bdb5339-4f38-4dbf-a681-2928d5de0504 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:15.257879 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bdb5339-4f38-4dbf-a681-2928d5de0504 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:15.286544 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bfb78e4a-7fb9-42f1-b90e-48ba34cbd521 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:15.287284 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-bfb78e4a-7fb9-42f1-b90e-48ba34cbd521 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:15.294004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bfb78e4a-7fb9-42f1-b90e-48ba34cbd521 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:15.294670 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bfb78e4a-7fb9-42f1-b90e-48ba34cbd521 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:15.295183 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bfb78e4a-7fb9-42f1-b90e-48ba34cbd521 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:15.295947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bfb78e4a-7fb9-42f1-b90e-48ba34cbd521 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:15.296479 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bfb78e4a-7fb9-42f1-b90e-48ba34cbd521 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:15.296977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bfb78e4a-7fb9-42f1-b90e-48ba34cbd521 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:15.446177 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5bdb5339-4f38-4dbf-a681-2928d5de0504 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:15.453734 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5bdb5339-4f38-4dbf-a681-2928d5de0504 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.209562 Aug 10 17:17:15.454419 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 211/409] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:15 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:15.473448 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bfb78e4a-7fb9-42f1-b90e-48ba34cbd521 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:15.481645 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bfb78e4a-7fb9-42f1-b90e-48ba34cbd521 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.199016 Aug 10 17:17:15.482269 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 199/410] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:15 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:15.603620 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a5f6e04d-5ba3-444c-ad20-3cc9d6d7ee73 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:15.604278 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a5f6e04d-5ba3-444c-ad20-3cc9d6d7ee73 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:15.610299 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5f6e04d-5ba3-444c-ad20-3cc9d6d7ee73 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:15.610822 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5f6e04d-5ba3-444c-ad20-3cc9d6d7ee73 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:15.611761 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5f6e04d-5ba3-444c-ad20-3cc9d6d7ee73 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:15.611947 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5f6e04d-5ba3-444c-ad20-3cc9d6d7ee73 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:15.612413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5f6e04d-5ba3-444c-ad20-3cc9d6d7ee73 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:15.612845 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5f6e04d-5ba3-444c-ad20-3cc9d6d7ee73 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:15.743775 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a5f6e04d-5ba3-444c-ad20-3cc9d6d7ee73 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:15.751763 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a5f6e04d-5ba3-444c-ad20-3cc9d6d7ee73 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.151981 Aug 10 17:17:15.752668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 212/411] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:15 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:15.779180 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7fea0434-6241-4d5a-a075-95afea5526e0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:15.779799 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7fea0434-6241-4d5a-a075-95afea5526e0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:15.785812 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7fea0434-6241-4d5a-a075-95afea5526e0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:15.786299 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7fea0434-6241-4d5a-a075-95afea5526e0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:15.786830 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7fea0434-6241-4d5a-a075-95afea5526e0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:15.787521 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7fea0434-6241-4d5a-a075-95afea5526e0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:15.787983 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7fea0434-6241-4d5a-a075-95afea5526e0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:15.788408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7fea0434-6241-4d5a-a075-95afea5526e0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:15.953989 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7fea0434-6241-4d5a-a075-95afea5526e0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:15.962684 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7fea0434-6241-4d5a-a075-95afea5526e0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:15.964189 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7fea0434-6241-4d5a-a075-95afea5526e0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:15.965355 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7fea0434-6241-4d5a-a075-95afea5526e0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.190053 Aug 10 17:17:15.965986 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 200/412] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:15 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:16.108032 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-929cb1af-0b98-48cf-95e4-3883ded36a56 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:16.108613 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-929cb1af-0b98-48cf-95e4-3883ded36a56 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:16.114635 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-929cb1af-0b98-48cf-95e4-3883ded36a56 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:16.115124 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-929cb1af-0b98-48cf-95e4-3883ded36a56 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:16.115567 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-929cb1af-0b98-48cf-95e4-3883ded36a56 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:16.116507 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-929cb1af-0b98-48cf-95e4-3883ded36a56 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:16.116696 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-929cb1af-0b98-48cf-95e4-3883ded36a56 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:16.117210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-929cb1af-0b98-48cf-95e4-3883ded36a56 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:16.248921 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-929cb1af-0b98-48cf-95e4-3883ded36a56 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:16.256512 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-929cb1af-0b98-48cf-95e4-3883ded36a56 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.152573 Aug 10 17:17:16.257987 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 213/413] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:16 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:16.475113 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1bf2d9af-ed33-4bea-ae10-37d0e353dc99 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:16.476311 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1bf2d9af-ed33-4bea-ae10-37d0e353dc99 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:16.482755 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bf2d9af-ed33-4bea-ae10-37d0e353dc99 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:16.483243 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bf2d9af-ed33-4bea-ae10-37d0e353dc99 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:16.483678 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bf2d9af-ed33-4bea-ae10-37d0e353dc99 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:16.484374 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bf2d9af-ed33-4bea-ae10-37d0e353dc99 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:16.484832 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bf2d9af-ed33-4bea-ae10-37d0e353dc99 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:16.485258 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bf2d9af-ed33-4bea-ae10-37d0e353dc99 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:16.508670 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0c2544ea-b059-49d8-98ea-feb27d664a7b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:16.509287 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0c2544ea-b059-49d8-98ea-feb27d664a7b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:16.515484 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c2544ea-b059-49d8-98ea-feb27d664a7b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:16.516023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c2544ea-b059-49d8-98ea-feb27d664a7b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:16.516495 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c2544ea-b059-49d8-98ea-feb27d664a7b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:16.517199 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c2544ea-b059-49d8-98ea-feb27d664a7b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:16.517665 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c2544ea-b059-49d8-98ea-feb27d664a7b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:16.518096 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c2544ea-b059-49d8-98ea-feb27d664a7b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:16.678008 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1bf2d9af-ed33-4bea-ae10-37d0e353dc99 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:16.688631 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1bf2d9af-ed33-4bea-ae10-37d0e353dc99 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.217288 Aug 10 17:17:16.704390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 201/414] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:16 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:16.704777 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0c2544ea-b059-49d8-98ea-feb27d664a7b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:16.714985 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0c2544ea-b059-49d8-98ea-feb27d664a7b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.210731 Aug 10 17:17:16.715563 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 214/415] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:16 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:16.774732 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9627477e-0386-4c5c-8610-39bbd73108a1 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:16.775272 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9627477e-0386-4c5c-8610-39bbd73108a1 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:16.781357 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9627477e-0386-4c5c-8610-39bbd73108a1 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:16.781845 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9627477e-0386-4c5c-8610-39bbd73108a1 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:16.782288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9627477e-0386-4c5c-8610-39bbd73108a1 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:16.783016 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9627477e-0386-4c5c-8610-39bbd73108a1 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:16.783477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9627477e-0386-4c5c-8610-39bbd73108a1 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:16.783922 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9627477e-0386-4c5c-8610-39bbd73108a1 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:16.926210 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9627477e-0386-4c5c-8610-39bbd73108a1 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:16.935090 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9627477e-0386-4c5c-8610-39bbd73108a1 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.164894 Aug 10 17:17:16.935665 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 202/416] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:16 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:16.989254 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c026127f-0ac7-48e8-975d-8a669680fa96 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:16.990001 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c026127f-0ac7-48e8-975d-8a669680fa96 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:16.996639 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c026127f-0ac7-48e8-975d-8a669680fa96 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:16.997101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c026127f-0ac7-48e8-975d-8a669680fa96 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:16.997531 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c026127f-0ac7-48e8-975d-8a669680fa96 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:16.998220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c026127f-0ac7-48e8-975d-8a669680fa96 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:16.998713 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c026127f-0ac7-48e8-975d-8a669680fa96 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:16.999138 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c026127f-0ac7-48e8-975d-8a669680fa96 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:17.015616 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:17.136202 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c026127f-0ac7-48e8-975d-8a669680fa96 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:17.144730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c026127f-0ac7-48e8-975d-8a669680fa96 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:17.146238 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c026127f-0ac7-48e8-975d-8a669680fa96 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:17.147480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c026127f-0ac7-48e8-975d-8a669680fa96 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.162116 Aug 10 17:17:17.148229 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 215/417] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:16 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:17.278975 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1713133c-3fd3-420c-a746-e1f97f72eacd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:17.279620 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1713133c-3fd3-420c-a746-e1f97f72eacd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:17.285715 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1713133c-3fd3-420c-a746-e1f97f72eacd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:17.288512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1713133c-3fd3-420c-a746-e1f97f72eacd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:17.288512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1713133c-3fd3-420c-a746-e1f97f72eacd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:17.288512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1713133c-3fd3-420c-a746-e1f97f72eacd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:17.288512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1713133c-3fd3-420c-a746-e1f97f72eacd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:17.289317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1713133c-3fd3-420c-a746-e1f97f72eacd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:17.432425 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1713133c-3fd3-420c-a746-e1f97f72eacd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:17.439917 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1713133c-3fd3-420c-a746-e1f97f72eacd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.164779 Aug 10 17:17:17.440475 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 203/418] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:17 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:17.709108 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1f623739-329b-41ed-86f9-c8fd3713d2d2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:17.710702 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1f623739-329b-41ed-86f9-c8fd3713d2d2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:17.721161 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f623739-329b-41ed-86f9-c8fd3713d2d2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:17.722022 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f623739-329b-41ed-86f9-c8fd3713d2d2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:17.722858 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f623739-329b-41ed-86f9-c8fd3713d2d2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:17.724099 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f623739-329b-41ed-86f9-c8fd3713d2d2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:17.724945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f623739-329b-41ed-86f9-c8fd3713d2d2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:17.726168 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f623739-329b-41ed-86f9-c8fd3713d2d2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:17.736424 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a2612d39-3507-4db2-90f8-1b3a91569b11 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:17.737655 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a2612d39-3507-4db2-90f8-1b3a91569b11 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:17.745220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a2612d39-3507-4db2-90f8-1b3a91569b11 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:17.749458 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a2612d39-3507-4db2-90f8-1b3a91569b11 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:17.749458 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a2612d39-3507-4db2-90f8-1b3a91569b11 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:17.749458 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a2612d39-3507-4db2-90f8-1b3a91569b11 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:17.749458 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a2612d39-3507-4db2-90f8-1b3a91569b11 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:17.749850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a2612d39-3507-4db2-90f8-1b3a91569b11 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:18.005570 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1f623739-329b-41ed-86f9-c8fd3713d2d2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:18.012122 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a2612d39-3507-4db2-90f8-1b3a91569b11 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:18.015114 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1f623739-329b-41ed-86f9-c8fd3713d2d2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.309626 Aug 10 17:17:18.016026 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 216/419] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:17 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:18.021290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b2af1a7b-559c-4ffd-8ded-6b09ddd22a85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:18.022450 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b2af1a7b-559c-4ffd-8ded-6b09ddd22a85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:18.025810 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a2612d39-3507-4db2-90f8-1b3a91569b11 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.293219 Aug 10 17:17:18.030075 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2af1a7b-559c-4ffd-8ded-6b09ddd22a85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:18.030679 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2af1a7b-559c-4ffd-8ded-6b09ddd22a85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:18.030806 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 204/420] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:17 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:18.031538 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2af1a7b-559c-4ffd-8ded-6b09ddd22a85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:18.032465 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2af1a7b-559c-4ffd-8ded-6b09ddd22a85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:18.033004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2af1a7b-559c-4ffd-8ded-6b09ddd22a85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:18.033525 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2af1a7b-559c-4ffd-8ded-6b09ddd22a85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:18.171035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4c6ecdef-2fc9-416d-90bd-262f6c632dff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:18.172622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4c6ecdef-2fc9-416d-90bd-262f6c632dff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:18.179543 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4c6ecdef-2fc9-416d-90bd-262f6c632dff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:18.180261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4c6ecdef-2fc9-416d-90bd-262f6c632dff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:18.180675 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4c6ecdef-2fc9-416d-90bd-262f6c632dff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:18.181981 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4c6ecdef-2fc9-416d-90bd-262f6c632dff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:18.181981 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4c6ecdef-2fc9-416d-90bd-262f6c632dff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:18.182269 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4c6ecdef-2fc9-416d-90bd-262f6c632dff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:18.184165 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b2af1a7b-559c-4ffd-8ded-6b09ddd22a85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:18.193318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b2af1a7b-559c-4ffd-8ded-6b09ddd22a85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.175828 Aug 10 17:17:18.194023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 217/421] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:18 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:18.201998 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:18.328901 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4c6ecdef-2fc9-416d-90bd-262f6c632dff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:18.338039 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4c6ecdef-2fc9-416d-90bd-262f6c632dff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:18.339600 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4c6ecdef-2fc9-416d-90bd-262f6c632dff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:18.340880 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4c6ecdef-2fc9-416d-90bd-262f6c632dff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1742 microversion: 2.20 time: 0.174188 Aug 10 17:17:18.341332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 205/422] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:18 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:17:18.462194 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8a7e3dd8-9194-486c-a1f4-86da597adc4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:18.462853 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8a7e3dd8-9194-486c-a1f4-86da597adc4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:18.470502 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a7e3dd8-9194-486c-a1f4-86da597adc4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:18.471264 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a7e3dd8-9194-486c-a1f4-86da597adc4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:18.471944 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a7e3dd8-9194-486c-a1f4-86da597adc4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:18.472844 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a7e3dd8-9194-486c-a1f4-86da597adc4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:18.473536 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a7e3dd8-9194-486c-a1f4-86da597adc4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:18.474182 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a7e3dd8-9194-486c-a1f4-86da597adc4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:18.706122 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-589826151", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1509534705", "security_groups": [{"name": "tempest-secgroup-smoke-1117335163"}], "block_device_mapping_v2": [{"uuid": "e1df96ef-6ae8-45d6-851d-9c191954c7dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c301088e-0ca6-4af1-acb5-e7ef09759e28"}]}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:18.729238 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8a7e3dd8-9194-486c-a1f4-86da597adc4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:18.741088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8a7e3dd8-9194-486c-a1f4-86da597adc4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1367 microversion: 2.1 time: 0.282589 Aug 10 17:17:18.742934 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 218/423] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:18 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:18.862432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] validate_networks() for [('c301088e-0ca6-4af1-acb5-e7ef09759e28', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:17:19.037198 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1983369e-02b0-491a-9e7f-a862edb3bb59 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:19.037731 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1983369e-02b0-491a-9e7f-a862edb3bb59 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:19.044389 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1983369e-02b0-491a-9e7f-a862edb3bb59 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:19.044878 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1983369e-02b0-491a-9e7f-a862edb3bb59 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:19.045312 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1983369e-02b0-491a-9e7f-a862edb3bb59 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:19.046013 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1983369e-02b0-491a-9e7f-a862edb3bb59 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:19.046508 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1983369e-02b0-491a-9e7f-a862edb3bb59 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:19.046957 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1983369e-02b0-491a-9e7f-a862edb3bb59 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:19.293008 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1983369e-02b0-491a-9e7f-a862edb3bb59 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:19.301058 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1983369e-02b0-491a-9e7f-a862edb3bb59 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.267719 Aug 10 17:17:19.301633 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 219/424] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:19 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:19.307209 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-434db954-7892-453a-969a-2d32cc545bd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:19.307825 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-434db954-7892-453a-969a-2d32cc545bd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:19.313958 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-434db954-7892-453a-969a-2d32cc545bd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:19.314496 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-434db954-7892-453a-969a-2d32cc545bd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:19.314943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-434db954-7892-453a-969a-2d32cc545bd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:19.315651 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-434db954-7892-453a-969a-2d32cc545bd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:19.316111 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-434db954-7892-453a-969a-2d32cc545bd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:19.316542 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-434db954-7892-453a-969a-2d32cc545bd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:19.348258 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:17:19.348622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:17:19.349115 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:17:19.349723 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:17:19.350138 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:17:19.362276 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:19.362886 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:19.363553 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:19.364368 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:19.365046 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:19.365588 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:19.385253 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Getting quotas for project e1bc63782f1d4b32ab58852232df16ac. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:17:19.390599 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Getting quotas for user 22a5224313e04d35af7fc7802ef5d6ed and project e1bc63782f1d4b32ab58852232df16ac. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:17:19.392442 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:19.470061 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:17:19.472497 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1df96ef-6ae8-45d6-851d-9c191954c7dc',volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:17:19.686043 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-434db954-7892-453a-969a-2d32cc545bd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:19.693543 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-434db954-7892-453a-969a-2d32cc545bd7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.390918 Aug 10 17:17:19.694748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 220/425] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:19 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:19.699498 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e487dfc1-324f-4fb9-8e11-a66b50c297fb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:19.701958 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e487dfc1-324f-4fb9-8e11-a66b50c297fb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:19.706019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e487dfc1-324f-4fb9-8e11-a66b50c297fb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:19.706560 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e487dfc1-324f-4fb9-8e11-a66b50c297fb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:19.707006 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e487dfc1-324f-4fb9-8e11-a66b50c297fb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:19.707712 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e487dfc1-324f-4fb9-8e11-a66b50c297fb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:19.708172 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e487dfc1-324f-4fb9-8e11-a66b50c297fb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:19.708600 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e487dfc1-324f-4fb9-8e11-a66b50c297fb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:19.841493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e487dfc1-324f-4fb9-8e11-a66b50c297fb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:19.849825 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e487dfc1-324f-4fb9-8e11-a66b50c297fb tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.153857 Aug 10 17:17:19.851003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 221/426] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:19 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:19.855723 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d7dd5fb6-3cae-41fa-ae08-66167a199262 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:19.856344 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d7dd5fb6-3cae-41fa-ae08-66167a199262 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:19.862537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7dd5fb6-3cae-41fa-ae08-66167a199262 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:19.862985 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7dd5fb6-3cae-41fa-ae08-66167a199262 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:19.863424 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7dd5fb6-3cae-41fa-ae08-66167a199262 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:19.864129 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7dd5fb6-3cae-41fa-ae08-66167a199262 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:19.864883 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7dd5fb6-3cae-41fa-ae08-66167a199262 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:19.865321 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7dd5fb6-3cae-41fa-ae08-66167a199262 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:19.869914 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-06717fa7-b2d4-4c13-bdc0-970decdf9400 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.167644 Aug 10 17:17:19.870963 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 206/427] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:17:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:17:19.875631 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-03e6e01d-f85d-45a4-9482-c41d1fda4250 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:19.876244 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-03e6e01d-f85d-45a4-9482-c41d1fda4250 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:19.882632 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03e6e01d-f85d-45a4-9482-c41d1fda4250 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:19.883140 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03e6e01d-f85d-45a4-9482-c41d1fda4250 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:19.883642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03e6e01d-f85d-45a4-9482-c41d1fda4250 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:19.884374 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03e6e01d-f85d-45a4-9482-c41d1fda4250 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:19.884810 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03e6e01d-f85d-45a4-9482-c41d1fda4250 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:19.885241 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03e6e01d-f85d-45a4-9482-c41d1fda4250 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:20.075811 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d7dd5fb6-3cae-41fa-ae08-66167a199262 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:20.083356 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-03e6e01d-f85d-45a4-9482-c41d1fda4250 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:20.084462 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d7dd5fb6-3cae-41fa-ae08-66167a199262 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:20.086162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d7dd5fb6-3cae-41fa-ae08-66167a199262 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:20.087363 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d7dd5fb6-3cae-41fa-ae08-66167a199262 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1742 microversion: 2.20 time: 0.235435 Aug 10 17:17:20.087937 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 222/428] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:19 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1742 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:20.091553 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-03e6e01d-f85d-45a4-9482-c41d1fda4250 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1556 microversion: 2.1 time: 0.219561 Aug 10 17:17:20.092364 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b50a1f0b-0426-4088-be9f-7d22d3d6f020 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:20.092515 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 207/429] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:19 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1556 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:20.093271 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b50a1f0b-0426-4088-be9f-7d22d3d6f020 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:20.112572 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f1685de2-6dba-42a5-84ce-ba34693fbc86 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:20.113067 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f1685de2-6dba-42a5-84ce-ba34693fbc86 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:20.120013 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1685de2-6dba-42a5-84ce-ba34693fbc86 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:20.120508 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1685de2-6dba-42a5-84ce-ba34693fbc86 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:20.120945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1685de2-6dba-42a5-84ce-ba34693fbc86 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:20.121651 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1685de2-6dba-42a5-84ce-ba34693fbc86 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:20.122102 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1685de2-6dba-42a5-84ce-ba34693fbc86 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:20.122691 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1685de2-6dba-42a5-84ce-ba34693fbc86 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:20.151420 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b50a1f0b-0426-4088-be9f-7d22d3d6f020 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:20.158623 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b50a1f0b-0426-4088-be9f-7d22d3d6f020 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1094 microversion: 2.1 time: 0.069599 Aug 10 17:17:20.159201 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 223/430] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:20 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:20.208394 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f1685de2-6dba-42a5-84ce-ba34693fbc86 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099718 Aug 10 17:17:20.209315 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 208/431] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 17:17:20 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:17:20.322666 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f1aa01e5-459d-4b3b-9ece-4ddccaddfc24 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:20.323301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f1aa01e5-459d-4b3b-9ece-4ddccaddfc24 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:20.330296 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f1aa01e5-459d-4b3b-9ece-4ddccaddfc24 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:20.330810 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f1aa01e5-459d-4b3b-9ece-4ddccaddfc24 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:20.331239 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f1aa01e5-459d-4b3b-9ece-4ddccaddfc24 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:20.331940 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f1aa01e5-459d-4b3b-9ece-4ddccaddfc24 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:20.332390 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f1aa01e5-459d-4b3b-9ece-4ddccaddfc24 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:20.332817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f1aa01e5-459d-4b3b-9ece-4ddccaddfc24 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:20.476903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f1aa01e5-459d-4b3b-9ece-4ddccaddfc24 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:20.485104 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f1aa01e5-459d-4b3b-9ece-4ddccaddfc24 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.166329 Aug 10 17:17:20.485686 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 224/432] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:20 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:20.715603 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-33167b3b-7579-44af-86cd-85b1f06bd0ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:20.716222 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-33167b3b-7579-44af-86cd-85b1f06bd0ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:20.722288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33167b3b-7579-44af-86cd-85b1f06bd0ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:20.722857 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33167b3b-7579-44af-86cd-85b1f06bd0ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:20.723345 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33167b3b-7579-44af-86cd-85b1f06bd0ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:20.723997 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33167b3b-7579-44af-86cd-85b1f06bd0ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:20.724466 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33167b3b-7579-44af-86cd-85b1f06bd0ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:20.724876 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33167b3b-7579-44af-86cd-85b1f06bd0ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:20.864259 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-33167b3b-7579-44af-86cd-85b1f06bd0ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:20.872265 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-176e5c80-fbae-4ee3-84c2-6562825b9b9f tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:20.872886 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-176e5c80-fbae-4ee3-84c2-6562825b9b9f tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:20.873286 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-33167b3b-7579-44af-86cd-85b1f06bd0ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.161491 Aug 10 17:17:20.873954 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 209/433] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:20 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:20.896726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-176e5c80-fbae-4ee3-84c2-6562825b9b9f tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:20.898192 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-176e5c80-fbae-4ee3-84c2-6562825b9b9f tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:20.898682 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-176e5c80-fbae-4ee3-84c2-6562825b9b9f tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:20.899460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-176e5c80-fbae-4ee3-84c2-6562825b9b9f tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:20.899982 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-176e5c80-fbae-4ee3-84c2-6562825b9b9f tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:20.900588 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-176e5c80-fbae-4ee3-84c2-6562825b9b9f tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:21.037235 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-176e5c80-fbae-4ee3-84c2-6562825b9b9f tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:21.045357 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-176e5c80-fbae-4ee3-84c2-6562825b9b9f tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.176918 Aug 10 17:17:21.046272 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 225/434] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:20 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:21.111565 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f1bcce4e-101d-4cd2-8fe7-03f89cb4cbbf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:21.112199 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f1bcce4e-101d-4cd2-8fe7-03f89cb4cbbf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:21.119317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1bcce4e-101d-4cd2-8fe7-03f89cb4cbbf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:21.119819 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1bcce4e-101d-4cd2-8fe7-03f89cb4cbbf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:21.120266 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1bcce4e-101d-4cd2-8fe7-03f89cb4cbbf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:21.120986 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1bcce4e-101d-4cd2-8fe7-03f89cb4cbbf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:21.121448 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1bcce4e-101d-4cd2-8fe7-03f89cb4cbbf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:21.121881 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1bcce4e-101d-4cd2-8fe7-03f89cb4cbbf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:21.181104 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d5d13474-1f0b-4f2e-900c-c5a5afccd1ef tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:21.182748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d5d13474-1f0b-4f2e-900c-c5a5afccd1ef tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:21.189501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d5d13474-1f0b-4f2e-900c-c5a5afccd1ef tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:21.190280 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d5d13474-1f0b-4f2e-900c-c5a5afccd1ef tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:21.190740 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d5d13474-1f0b-4f2e-900c-c5a5afccd1ef tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:21.191614 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d5d13474-1f0b-4f2e-900c-c5a5afccd1ef tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:21.192108 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d5d13474-1f0b-4f2e-900c-c5a5afccd1ef tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:21.192533 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d5d13474-1f0b-4f2e-900c-c5a5afccd1ef tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:21.278796 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f1bcce4e-101d-4cd2-8fe7-03f89cb4cbbf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:21.292384 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f1bcce4e-101d-4cd2-8fe7-03f89cb4cbbf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:21.293912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f1bcce4e-101d-4cd2-8fe7-03f89cb4cbbf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:21.295099 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f1bcce4e-101d-4cd2-8fe7-03f89cb4cbbf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1742 microversion: 2.20 time: 0.187799 Aug 10 17:17:21.295643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 210/435] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:21 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:21.300250 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-1fdad621-8890-4c53-8711-b182078560d8 req-8bd33908-0e7d-4ea0-b2e3-63e556377b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceaebb89-9428-4490-bb2f-fe34917029df", "tag": "91640510-d3e4-4993-9b5c-ceecbca49523"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:21.312694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-1fdad621-8890-4c53-8711-b182078560d8 req-8bd33908-0e7d-4ea0-b2e3-63e556377b46 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:21.313345 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-1fdad621-8890-4c53-8711-b182078560d8 req-8bd33908-0e7d-4ea0-b2e3-63e556377b46 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:21.313932 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-1fdad621-8890-4c53-8711-b182078560d8 req-8bd33908-0e7d-4ea0-b2e3-63e556377b46 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:21.320678 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d5d13474-1f0b-4f2e-900c-c5a5afccd1ef tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:21.327233 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-1fdad621-8890-4c53-8711-b182078560d8 req-8bd33908-0e7d-4ea0-b2e3-63e556377b46 service nova] Creating event network-changed:91640510-d3e4-4993-9b5c-ceecbca49523 for instance ceaebb89-9428-4490-bb2f-fe34917029df on hv-cinder-85272 Aug 10 17:17:21.329765 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d5d13474-1f0b-4f2e-900c-c5a5afccd1ef tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1144 microversion: 2.1 time: 0.152670 Aug 10 17:17:21.331521 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 226/436] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:21 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1144 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:21.332478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-1fdad621-8890-4c53-8711-b182078560d8 req-8bd33908-0e7d-4ea0-b2e3-63e556377b46 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035490 Aug 10 17:17:21.333060 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 211/437] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:17:21.507158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-aa086eb1-de12-4edf-9d34-4a19e98d03b1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:21.507687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-aa086eb1-de12-4edf-9d34-4a19e98d03b1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:21.513903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa086eb1-de12-4edf-9d34-4a19e98d03b1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:21.514428 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa086eb1-de12-4edf-9d34-4a19e98d03b1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:21.514874 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa086eb1-de12-4edf-9d34-4a19e98d03b1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:21.515627 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa086eb1-de12-4edf-9d34-4a19e98d03b1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:21.516079 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa086eb1-de12-4edf-9d34-4a19e98d03b1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:21.516509 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa086eb1-de12-4edf-9d34-4a19e98d03b1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:21.661868 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-aa086eb1-de12-4edf-9d34-4a19e98d03b1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:21.670413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-aa086eb1-de12-4edf-9d34-4a19e98d03b1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.167537 Aug 10 17:17:21.670990 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 227/438] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:21 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:21.895458 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-031732fa-9464-4ad8-92f7-a6411ebe49e2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:21.896328 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-031732fa-9464-4ad8-92f7-a6411ebe49e2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:21.903298 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-031732fa-9464-4ad8-92f7-a6411ebe49e2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:21.903786 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-031732fa-9464-4ad8-92f7-a6411ebe49e2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:21.904222 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-031732fa-9464-4ad8-92f7-a6411ebe49e2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:21.904919 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-031732fa-9464-4ad8-92f7-a6411ebe49e2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:21.905424 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-031732fa-9464-4ad8-92f7-a6411ebe49e2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:21.905850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-031732fa-9464-4ad8-92f7-a6411ebe49e2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:22.041706 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-031732fa-9464-4ad8-92f7-a6411ebe49e2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:22.049734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-031732fa-9464-4ad8-92f7-a6411ebe49e2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.158986 Aug 10 17:17:22.050321 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 212/439] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:21 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:22.066316 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c8e909d7-2b5c-4be2-8c17-b75b1fe32e81 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:22.066976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c8e909d7-2b5c-4be2-8c17-b75b1fe32e81 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:22.074173 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8e909d7-2b5c-4be2-8c17-b75b1fe32e81 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:22.074773 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8e909d7-2b5c-4be2-8c17-b75b1fe32e81 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:22.075152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8e909d7-2b5c-4be2-8c17-b75b1fe32e81 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:22.075869 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8e909d7-2b5c-4be2-8c17-b75b1fe32e81 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:22.076499 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8e909d7-2b5c-4be2-8c17-b75b1fe32e81 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:22.076794 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8e909d7-2b5c-4be2-8c17-b75b1fe32e81 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:22.226536 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c8e909d7-2b5c-4be2-8c17-b75b1fe32e81 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:22.235524 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c8e909d7-2b5c-4be2-8c17-b75b1fe32e81 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.173008 Aug 10 17:17:22.236122 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 228/440] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:22 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:22.325683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b4bca451-2899-445b-ba0f-12e1d04a284c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:22.326251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b4bca451-2899-445b-ba0f-12e1d04a284c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:22.332534 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b4bca451-2899-445b-ba0f-12e1d04a284c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:22.333031 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b4bca451-2899-445b-ba0f-12e1d04a284c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:22.333469 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b4bca451-2899-445b-ba0f-12e1d04a284c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:22.334405 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b4bca451-2899-445b-ba0f-12e1d04a284c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:22.334870 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b4bca451-2899-445b-ba0f-12e1d04a284c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:22.335301 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b4bca451-2899-445b-ba0f-12e1d04a284c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:22.354785 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-76fc92b3-c791-4832-96b0-e645dbacbe27 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:22.356975 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-76fc92b3-c791-4832-96b0-e645dbacbe27 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:22.363943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-76fc92b3-c791-4832-96b0-e645dbacbe27 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:22.364727 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-76fc92b3-c791-4832-96b0-e645dbacbe27 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:22.365278 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-76fc92b3-c791-4832-96b0-e645dbacbe27 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:22.366771 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-76fc92b3-c791-4832-96b0-e645dbacbe27 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:22.367552 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-76fc92b3-c791-4832-96b0-e645dbacbe27 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:22.368205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-76fc92b3-c791-4832-96b0-e645dbacbe27 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:22.438649 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-76fc92b3-c791-4832-96b0-e645dbacbe27 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:22.447778 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-76fc92b3-c791-4832-96b0-e645dbacbe27 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1144 microversion: 2.1 time: 0.098655 Aug 10 17:17:22.448431 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 229/441] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:22 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1144 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:22.504651 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b4bca451-2899-445b-ba0f-12e1d04a284c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:22.513520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b4bca451-2899-445b-ba0f-12e1d04a284c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:22.515079 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b4bca451-2899-445b-ba0f-12e1d04a284c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:22.516317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b4bca451-2899-445b-ba0f-12e1d04a284c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1742 microversion: 2.20 time: 0.196670 Aug 10 17:17:22.516879 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 213/442] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:22 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1742 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:22.692571 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6c510a00-ca01-4915-bf27-d5496e2eb5b0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:22.693346 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6c510a00-ca01-4915-bf27-d5496e2eb5b0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:22.700434 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c510a00-ca01-4915-bf27-d5496e2eb5b0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:22.701024 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c510a00-ca01-4915-bf27-d5496e2eb5b0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:22.701467 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c510a00-ca01-4915-bf27-d5496e2eb5b0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:22.702171 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c510a00-ca01-4915-bf27-d5496e2eb5b0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:22.702669 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c510a00-ca01-4915-bf27-d5496e2eb5b0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:22.703104 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c510a00-ca01-4915-bf27-d5496e2eb5b0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:22.834052 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6c510a00-ca01-4915-bf27-d5496e2eb5b0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:22.842043 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6c510a00-ca01-4915-bf27-d5496e2eb5b0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.153823 Aug 10 17:17:22.842646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 230/443] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:22 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:23.072789 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-65835334-081e-41a7-8cea-c9eb7ac7f1d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:23.073409 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-65835334-081e-41a7-8cea-c9eb7ac7f1d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:23.079411 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65835334-081e-41a7-8cea-c9eb7ac7f1d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:23.079890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65835334-081e-41a7-8cea-c9eb7ac7f1d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:23.080320 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65835334-081e-41a7-8cea-c9eb7ac7f1d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:23.081009 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65835334-081e-41a7-8cea-c9eb7ac7f1d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:23.081456 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65835334-081e-41a7-8cea-c9eb7ac7f1d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:23.081875 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65835334-081e-41a7-8cea-c9eb7ac7f1d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:23.207033 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-9138f160-915b-42ea-8a7f-198fad6f946e req-aba75ecf-9b7c-4d77-bf60-b56984afcb03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e46673f-6139-4b97-b57a-b65886eb16b1", "name": "network-vif-plugged", "status": "completed", "tag": "65857e53-de9a-43a1-9362-2d62644ab14a"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:23.219766 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-65835334-081e-41a7-8cea-c9eb7ac7f1d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:23.222845 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-9138f160-915b-42ea-8a7f-198fad6f946e req-aba75ecf-9b7c-4d77-bf60-b56984afcb03 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:23.223339 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-9138f160-915b-42ea-8a7f-198fad6f946e req-aba75ecf-9b7c-4d77-bf60-b56984afcb03 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:23.223776 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-9138f160-915b-42ea-8a7f-198fad6f946e req-aba75ecf-9b7c-4d77-bf60-b56984afcb03 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:23.227832 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-65835334-081e-41a7-8cea-c9eb7ac7f1d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.159489 Aug 10 17:17:23.228411 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 214/444] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:23 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:23.236060 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-9138f160-915b-42ea-8a7f-198fad6f946e req-aba75ecf-9b7c-4d77-bf60-b56984afcb03 service nova] Creating event network-vif-plugged:65857e53-de9a-43a1-9362-2d62644ab14a for instance 1e46673f-6139-4b97-b57a-b65886eb16b1 on hv-cinder-85272 Aug 10 17:17:23.241241 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-9138f160-915b-42ea-8a7f-198fad6f946e req-aba75ecf-9b7c-4d77-bf60-b56984afcb03 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037853 Aug 10 17:17:23.241861 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 231/445] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:17:23.257746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5b43c13c-47f9-4ef0-9c6e-5e00a9f38444 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:23.258418 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5b43c13c-47f9-4ef0-9c6e-5e00a9f38444 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:23.264812 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b43c13c-47f9-4ef0-9c6e-5e00a9f38444 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:23.265363 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b43c13c-47f9-4ef0-9c6e-5e00a9f38444 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:23.265803 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b43c13c-47f9-4ef0-9c6e-5e00a9f38444 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:23.266539 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b43c13c-47f9-4ef0-9c6e-5e00a9f38444 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:23.266992 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b43c13c-47f9-4ef0-9c6e-5e00a9f38444 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:23.267537 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b43c13c-47f9-4ef0-9c6e-5e00a9f38444 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:23.409544 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5b43c13c-47f9-4ef0-9c6e-5e00a9f38444 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:23.418093 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5b43c13c-47f9-4ef0-9c6e-5e00a9f38444 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1723 microversion: 2.1 time: 0.164979 Aug 10 17:17:23.418695 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 215/446] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:23 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:23.468885 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ab885dc0-f8ee-4f61-b858-9e1d2efedf37 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:23.469596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ab885dc0-f8ee-4f61-b858-9e1d2efedf37 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:23.476156 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab885dc0-f8ee-4f61-b858-9e1d2efedf37 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:23.476643 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab885dc0-f8ee-4f61-b858-9e1d2efedf37 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:23.477084 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab885dc0-f8ee-4f61-b858-9e1d2efedf37 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:23.477784 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab885dc0-f8ee-4f61-b858-9e1d2efedf37 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:23.478917 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab885dc0-f8ee-4f61-b858-9e1d2efedf37 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:23.479481 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab885dc0-f8ee-4f61-b858-9e1d2efedf37 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:23.540983 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-071c956d-44d2-4db8-ade6-aa856f7a05db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:23.541609 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-071c956d-44d2-4db8-ade6-aa856f7a05db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:23.542330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ab885dc0-f8ee-4f61-b858-9e1d2efedf37 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:23.547782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-071c956d-44d2-4db8-ade6-aa856f7a05db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:23.548835 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-071c956d-44d2-4db8-ade6-aa856f7a05db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:23.548835 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-071c956d-44d2-4db8-ade6-aa856f7a05db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:23.549388 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-071c956d-44d2-4db8-ade6-aa856f7a05db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:23.549843 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-071c956d-44d2-4db8-ade6-aa856f7a05db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:23.549951 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ab885dc0-f8ee-4f61-b858-9e1d2efedf37 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1144 microversion: 2.1 time: 0.085275 Aug 10 17:17:23.550308 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-071c956d-44d2-4db8-ade6-aa856f7a05db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:23.550439 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 232/447] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:23 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:23.691356 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-071c956d-44d2-4db8-ade6-aa856f7a05db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:23.700950 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-071c956d-44d2-4db8-ade6-aa856f7a05db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:23.703637 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-071c956d-44d2-4db8-ade6-aa856f7a05db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:23.704346 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-071c956d-44d2-4db8-ade6-aa856f7a05db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1742 microversion: 2.20 time: 0.168927 Aug 10 17:17:23.704927 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 216/448] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:23 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1742 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:23.862849 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cee4da0e-af31-477b-be99-f32d57c96f15 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:23.863361 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cee4da0e-af31-477b-be99-f32d57c96f15 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:23.869874 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cee4da0e-af31-477b-be99-f32d57c96f15 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:23.870374 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cee4da0e-af31-477b-be99-f32d57c96f15 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:23.870817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cee4da0e-af31-477b-be99-f32d57c96f15 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:23.871506 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cee4da0e-af31-477b-be99-f32d57c96f15 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:23.871956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cee4da0e-af31-477b-be99-f32d57c96f15 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:23.872378 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cee4da0e-af31-477b-be99-f32d57c96f15 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:24.010514 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cee4da0e-af31-477b-be99-f32d57c96f15 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:24.013178 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:24.019608 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cee4da0e-af31-477b-be99-f32d57c96f15 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.160561 Aug 10 17:17:24.020183 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 233/449] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:23 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:24.249835 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-041d120b-3073-4535-804f-7aa0dc11a101 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:24.250484 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-041d120b-3073-4535-804f-7aa0dc11a101 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:24.256991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-041d120b-3073-4535-804f-7aa0dc11a101 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:24.257491 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-041d120b-3073-4535-804f-7aa0dc11a101 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:24.257944 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-041d120b-3073-4535-804f-7aa0dc11a101 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:24.258667 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-041d120b-3073-4535-804f-7aa0dc11a101 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:24.259126 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-041d120b-3073-4535-804f-7aa0dc11a101 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:24.259555 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-041d120b-3073-4535-804f-7aa0dc11a101 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:24.395231 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-041d120b-3073-4535-804f-7aa0dc11a101 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:24.403943 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-041d120b-3073-4535-804f-7aa0dc11a101 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.158968 Aug 10 17:17:24.408947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 217/450] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:24 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:24.441072 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-aeaa971c-b12b-4ab9-b476-eefba0a2e07b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:24.441691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-aeaa971c-b12b-4ab9-b476-eefba0a2e07b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:24.447988 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aeaa971c-b12b-4ab9-b476-eefba0a2e07b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:24.448486 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aeaa971c-b12b-4ab9-b476-eefba0a2e07b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:24.448931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aeaa971c-b12b-4ab9-b476-eefba0a2e07b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:24.449633 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aeaa971c-b12b-4ab9-b476-eefba0a2e07b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:24.450094 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aeaa971c-b12b-4ab9-b476-eefba0a2e07b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:24.450556 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aeaa971c-b12b-4ab9-b476-eefba0a2e07b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:24.577056 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-72a07c60-6e16-4ea0-823a-65a767dd3aec tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:24.577725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-72a07c60-6e16-4ea0-823a-65a767dd3aec tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:24.584139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-72a07c60-6e16-4ea0-823a-65a767dd3aec tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:24.584593 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-72a07c60-6e16-4ea0-823a-65a767dd3aec tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:24.585203 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-72a07c60-6e16-4ea0-823a-65a767dd3aec tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:24.586091 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-72a07c60-6e16-4ea0-823a-65a767dd3aec tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:24.586586 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-72a07c60-6e16-4ea0-823a-65a767dd3aec tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:24.587024 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-72a07c60-6e16-4ea0-823a-65a767dd3aec tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:24.599949 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-aeaa971c-b12b-4ab9-b476-eefba0a2e07b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:24.622020 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-aeaa971c-b12b-4ab9-b476-eefba0a2e07b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1700 microversion: 2.1 time: 0.185695 Aug 10 17:17:24.622667 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 234/451] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:24 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1700 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:24.643872 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d3cd647c-7d47-4ab4-b11c-3089fc782c40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:24.651030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3cd647c-7d47-4ab4-b11c-3089fc782c40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:24.651665 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3cd647c-7d47-4ab4-b11c-3089fc782c40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:24.652118 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3cd647c-7d47-4ab4-b11c-3089fc782c40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:24.658138 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-72a07c60-6e16-4ea0-823a-65a767dd3aec tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:24.667797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-72a07c60-6e16-4ea0-823a-65a767dd3aec tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1136 microversion: 2.1 time: 0.100892 Aug 10 17:17:24.668424 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 218/452] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:24 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1136 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:24.716190 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d3cd647c-7d47-4ab4-b11c-3089fc782c40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Going to try to start instance {{(pid=121232) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 17:17:24.728548 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a5a022b4-daaf-4ff0-b152-8187f956a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:24.729185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a5a022b4-daaf-4ff0-b152-8187f956a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:24.735380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a5a022b4-daaf-4ff0-b152-8187f956a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:24.735892 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a5a022b4-daaf-4ff0-b152-8187f956a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:24.736339 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a5a022b4-daaf-4ff0-b152-8187f956a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:24.737045 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a5a022b4-daaf-4ff0-b152-8187f956a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:24.737504 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a5a022b4-daaf-4ff0-b152-8187f956a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:24.737927 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a5a022b4-daaf-4ff0-b152-8187f956a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:24.870230 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a5a022b4-daaf-4ff0-b152-8187f956a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:24.878257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a5a022b4-daaf-4ff0-b152-8187f956a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:24.879804 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a5a022b4-daaf-4ff0-b152-8187f956a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:24.882391 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a5a022b4-daaf-4ff0-b152-8187f956a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1742 microversion: 2.20 time: 0.157552 Aug 10 17:17:24.882391 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 219/453] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:24 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:17:25.002318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d3cd647c-7d47-4ab4-b11c-3089fc782c40 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "POST /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/action" status: 202 len: 0 microversion: 2.1 time: 0.362381 Aug 10 17:17:25.003023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 235/454] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:17:24 2022] POST /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:17:25.011688 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-72b832d7-7502-4515-9380-bcf4a712d66b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:25.012340 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-72b832d7-7502-4515-9380-bcf4a712d66b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:25.018373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-72b832d7-7502-4515-9380-bcf4a712d66b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:25.019011 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-72b832d7-7502-4515-9380-bcf4a712d66b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:25.019455 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-72b832d7-7502-4515-9380-bcf4a712d66b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:25.020155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-72b832d7-7502-4515-9380-bcf4a712d66b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:25.020611 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-72b832d7-7502-4515-9380-bcf4a712d66b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:25.021058 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-72b832d7-7502-4515-9380-bcf4a712d66b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:25.041958 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-92af420e-8641-45c2-bdd7-9c1e48152159 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:25.042696 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-92af420e-8641-45c2-bdd7-9c1e48152159 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:25.049180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92af420e-8641-45c2-bdd7-9c1e48152159 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:25.049615 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92af420e-8641-45c2-bdd7-9c1e48152159 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:25.050044 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92af420e-8641-45c2-bdd7-9c1e48152159 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:25.050772 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92af420e-8641-45c2-bdd7-9c1e48152159 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:25.051284 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92af420e-8641-45c2-bdd7-9c1e48152159 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:25.051763 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92af420e-8641-45c2-bdd7-9c1e48152159 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:25.227711 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-72b832d7-7502-4515-9380-bcf4a712d66b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:25.235743 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-92af420e-8641-45c2-bdd7-9c1e48152159 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:25.236040 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-72b832d7-7502-4515-9380-bcf4a712d66b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1709 microversion: 2.1 time: 0.228495 Aug 10 17:17:25.236640 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 220/455] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:25 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1709 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:25.243851 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-92af420e-8641-45c2-bdd7-9c1e48152159 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.207004 Aug 10 17:17:25.244435 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 236/456] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:25 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:25.439582 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-96ba22ed-7aeb-4b3b-a88c-cfa961bef0ae tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:25.440855 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-96ba22ed-7aeb-4b3b-a88c-cfa961bef0ae tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:25.448738 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-96ba22ed-7aeb-4b3b-a88c-cfa961bef0ae tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:25.449494 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-96ba22ed-7aeb-4b3b-a88c-cfa961bef0ae tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:25.454271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-96ba22ed-7aeb-4b3b-a88c-cfa961bef0ae tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:25.454271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-96ba22ed-7aeb-4b3b-a88c-cfa961bef0ae tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:25.454271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-96ba22ed-7aeb-4b3b-a88c-cfa961bef0ae tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:25.454271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-96ba22ed-7aeb-4b3b-a88c-cfa961bef0ae tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:25.624080 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-96ba22ed-7aeb-4b3b-a88c-cfa961bef0ae tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:25.632888 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-96ba22ed-7aeb-4b3b-a88c-cfa961bef0ae tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.196596 Aug 10 17:17:25.633474 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 221/457] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:25 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:25.689592 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0c0b61b2-fde2-48d8-aea5-2d196720a4be tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:25.690906 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0c0b61b2-fde2-48d8-aea5-2d196720a4be tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:25.699810 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c0b61b2-fde2-48d8-aea5-2d196720a4be tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:25.700531 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c0b61b2-fde2-48d8-aea5-2d196720a4be tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:25.701140 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c0b61b2-fde2-48d8-aea5-2d196720a4be tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:25.702016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c0b61b2-fde2-48d8-aea5-2d196720a4be tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:25.702685 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c0b61b2-fde2-48d8-aea5-2d196720a4be tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:25.703119 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c0b61b2-fde2-48d8-aea5-2d196720a4be tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:25.773809 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0c0b61b2-fde2-48d8-aea5-2d196720a4be tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:25.783332 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0c0b61b2-fde2-48d8-aea5-2d196720a4be tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1136 microversion: 2.1 time: 0.097807 Aug 10 17:17:25.785195 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 237/458] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:25 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1136 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:25.909758 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6cf81c64-ad5b-4f30-9b7b-286db5b90de4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:25.910704 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6cf81c64-ad5b-4f30-9b7b-286db5b90de4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:25.918745 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cf81c64-ad5b-4f30-9b7b-286db5b90de4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:25.919537 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cf81c64-ad5b-4f30-9b7b-286db5b90de4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:25.920055 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cf81c64-ad5b-4f30-9b7b-286db5b90de4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:25.920927 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cf81c64-ad5b-4f30-9b7b-286db5b90de4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:25.921372 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cf81c64-ad5b-4f30-9b7b-286db5b90de4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:25.921803 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cf81c64-ad5b-4f30-9b7b-286db5b90de4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:26.077928 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6cf81c64-ad5b-4f30-9b7b-286db5b90de4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:26.086650 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6cf81c64-ad5b-4f30-9b7b-286db5b90de4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:26.088219 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6cf81c64-ad5b-4f30-9b7b-286db5b90de4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:26.089657 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6cf81c64-ad5b-4f30-9b7b-286db5b90de4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1737 microversion: 2.20 time: 0.183758 Aug 10 17:17:26.090224 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 222/459] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:25 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:26.257950 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-76c72a3f-b75c-41f9-b4ae-6fae2d4d8641 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:26.258612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-76c72a3f-b75c-41f9-b4ae-6fae2d4d8641 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:26.267874 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7cfb3000-a753-4a2c-84fc-841e88add2ca tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:26.268521 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7cfb3000-a753-4a2c-84fc-841e88add2ca tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:26.268695 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-76c72a3f-b75c-41f9-b4ae-6fae2d4d8641 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:26.269601 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-76c72a3f-b75c-41f9-b4ae-6fae2d4d8641 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:26.270059 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-76c72a3f-b75c-41f9-b4ae-6fae2d4d8641 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:26.270979 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-76c72a3f-b75c-41f9-b4ae-6fae2d4d8641 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:26.271468 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-76c72a3f-b75c-41f9-b4ae-6fae2d4d8641 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:26.271899 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-76c72a3f-b75c-41f9-b4ae-6fae2d4d8641 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:26.279565 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7cfb3000-a753-4a2c-84fc-841e88add2ca tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:26.279565 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7cfb3000-a753-4a2c-84fc-841e88add2ca tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:26.280040 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7cfb3000-a753-4a2c-84fc-841e88add2ca tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:26.280764 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7cfb3000-a753-4a2c-84fc-841e88add2ca tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:26.281277 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7cfb3000-a753-4a2c-84fc-841e88add2ca tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:26.281967 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7cfb3000-a753-4a2c-84fc-841e88add2ca tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:26.541204 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-76c72a3f-b75c-41f9-b4ae-6fae2d4d8641 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:26.550594 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-76c72a3f-b75c-41f9-b4ae-6fae2d4d8641 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1709 microversion: 2.1 time: 0.296960 Aug 10 17:17:26.553119 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7cfb3000-a753-4a2c-84fc-841e88add2ca tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:26.555449 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 238/460] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:26 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1709 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:26.561076 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:26.566172 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7cfb3000-a753-4a2c-84fc-841e88add2ca tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.303712 Aug 10 17:17:26.566933 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 223/461] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:26 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:26.654088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9c2e09d3-c08a-42c6-b9a6-1ee718deec18 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:26.655024 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9c2e09d3-c08a-42c6-b9a6-1ee718deec18 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:26.664013 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c2e09d3-c08a-42c6-b9a6-1ee718deec18 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:26.665470 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c2e09d3-c08a-42c6-b9a6-1ee718deec18 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:26.666167 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c2e09d3-c08a-42c6-b9a6-1ee718deec18 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:26.667234 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c2e09d3-c08a-42c6-b9a6-1ee718deec18 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:26.667958 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c2e09d3-c08a-42c6-b9a6-1ee718deec18 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:26.668606 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c2e09d3-c08a-42c6-b9a6-1ee718deec18 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:26.805701 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d464fb76-92ca-406e-ae50-5bf4a71f0977 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:26.806334 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d464fb76-92ca-406e-ae50-5bf4a71f0977 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:26.834181 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d464fb76-92ca-406e-ae50-5bf4a71f0977 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:26.835109 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d464fb76-92ca-406e-ae50-5bf4a71f0977 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:26.835815 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d464fb76-92ca-406e-ae50-5bf4a71f0977 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:26.838247 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d464fb76-92ca-406e-ae50-5bf4a71f0977 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:26.839548 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d464fb76-92ca-406e-ae50-5bf4a71f0977 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:26.840433 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d464fb76-92ca-406e-ae50-5bf4a71f0977 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:26.947548 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d464fb76-92ca-406e-ae50-5bf4a71f0977 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:26.956290 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d464fb76-92ca-406e-ae50-5bf4a71f0977 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1200 microversion: 2.1 time: 0.155074 Aug 10 17:17:26.961558 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 224/462] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:26 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1200 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:26.961723 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9c2e09d3-c08a-42c6-b9a6-1ee718deec18 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:26.971629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9c2e09d3-c08a-42c6-b9a6-1ee718deec18 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.321309 Aug 10 17:17:26.972876 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 239/463] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:26 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:27.113633 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b3034024-0014-41f4-ae3f-fda10a5519d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:27.114865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b3034024-0014-41f4-ae3f-fda10a5519d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:27.125224 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3034024-0014-41f4-ae3f-fda10a5519d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:27.126537 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3034024-0014-41f4-ae3f-fda10a5519d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:27.127675 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3034024-0014-41f4-ae3f-fda10a5519d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:27.129059 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3034024-0014-41f4-ae3f-fda10a5519d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:27.130337 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3034024-0014-41f4-ae3f-fda10a5519d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:27.134173 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3034024-0014-41f4-ae3f-fda10a5519d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:27.380748 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b3034024-0014-41f4-ae3f-fda10a5519d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:27.390746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b3034024-0014-41f4-ae3f-fda10a5519d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:27.392862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b3034024-0014-41f4-ae3f-fda10a5519d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:27.394397 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b3034024-0014-41f4-ae3f-fda10a5519d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1737 microversion: 2.20 time: 0.285072 Aug 10 17:17:27.395120 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 225/464] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:27 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1737 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:17:27.579255 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-388036fe-fab9-4769-acc9-cfe94105de01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:27.580374 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-388036fe-fab9-4769-acc9-cfe94105de01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:27.589034 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-752dc63c-d4ee-424a-8cbc-b24bb4177c4f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:27.589659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-752dc63c-d4ee-424a-8cbc-b24bb4177c4f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:27.596308 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-388036fe-fab9-4769-acc9-cfe94105de01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:27.600797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-752dc63c-d4ee-424a-8cbc-b24bb4177c4f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:27.601760 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-388036fe-fab9-4769-acc9-cfe94105de01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:27.602574 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-752dc63c-d4ee-424a-8cbc-b24bb4177c4f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:27.603252 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-388036fe-fab9-4769-acc9-cfe94105de01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:27.604199 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-388036fe-fab9-4769-acc9-cfe94105de01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:27.604881 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-752dc63c-d4ee-424a-8cbc-b24bb4177c4f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:27.605835 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-752dc63c-d4ee-424a-8cbc-b24bb4177c4f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:27.606592 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-388036fe-fab9-4769-acc9-cfe94105de01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:27.607246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-388036fe-fab9-4769-acc9-cfe94105de01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:27.607926 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-752dc63c-d4ee-424a-8cbc-b24bb4177c4f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:27.611461 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-752dc63c-d4ee-424a-8cbc-b24bb4177c4f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:28.019067 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-388036fe-fab9-4769-acc9-cfe94105de01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:28.034480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-388036fe-fab9-4769-acc9-cfe94105de01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1709 microversion: 2.1 time: 0.458871 Aug 10 17:17:28.046379 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 240/465] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:27 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1709 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:28.046379 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8133c09c-98ce-45e2-b6ea-a0ec4573d3b1 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:28.046379 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8133c09c-98ce-45e2-b6ea-a0ec4573d3b1 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:28.057643 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8133c09c-98ce-45e2-b6ea-a0ec4573d3b1 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:28.058145 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8133c09c-98ce-45e2-b6ea-a0ec4573d3b1 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:28.058654 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8133c09c-98ce-45e2-b6ea-a0ec4573d3b1 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:28.059387 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8133c09c-98ce-45e2-b6ea-a0ec4573d3b1 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:28.060244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8133c09c-98ce-45e2-b6ea-a0ec4573d3b1 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:28.060900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8133c09c-98ce-45e2-b6ea-a0ec4573d3b1 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:28.091226 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-752dc63c-d4ee-424a-8cbc-b24bb4177c4f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:28.098946 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-752dc63c-d4ee-424a-8cbc-b24bb4177c4f tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.514250 Aug 10 17:17:28.099843 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 226/466] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:27 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:28.106502 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2da3b8e9-f688-4af2-85a1-f2b0eb34d1f1 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:28.121945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2da3b8e9-f688-4af2-85a1-f2b0eb34d1f1 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:28.128929 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2da3b8e9-f688-4af2-85a1-f2b0eb34d1f1 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:28.133558 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2da3b8e9-f688-4af2-85a1-f2b0eb34d1f1 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:28.134306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2da3b8e9-f688-4af2-85a1-f2b0eb34d1f1 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:28.135075 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2da3b8e9-f688-4af2-85a1-f2b0eb34d1f1 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:28.135533 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2da3b8e9-f688-4af2-85a1-f2b0eb34d1f1 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:28.136221 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2da3b8e9-f688-4af2-85a1-f2b0eb34d1f1 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:28.173428 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8133c09c-98ce-45e2-b6ea-a0ec4573d3b1 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:28.184402 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8133c09c-98ce-45e2-b6ea-a0ec4573d3b1 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1210 microversion: 2.1 time: 0.148287 Aug 10 17:17:28.195749 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 241/467] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:28 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1210 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:28.370870 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2da3b8e9-f688-4af2-85a1-f2b0eb34d1f1 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:28.380993 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2da3b8e9-f688-4af2-85a1-f2b0eb34d1f1 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.278549 Aug 10 17:17:28.382859 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 227/468] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:28 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:28.424520 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-eee92b0e-0657-4636-a688-11915f0ae830 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:28.425348 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-eee92b0e-0657-4636-a688-11915f0ae830 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:28.434656 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eee92b0e-0657-4636-a688-11915f0ae830 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:28.435173 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eee92b0e-0657-4636-a688-11915f0ae830 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:28.435596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eee92b0e-0657-4636-a688-11915f0ae830 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:28.466541 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eee92b0e-0657-4636-a688-11915f0ae830 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:28.467263 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eee92b0e-0657-4636-a688-11915f0ae830 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:28.469173 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eee92b0e-0657-4636-a688-11915f0ae830 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:28.767173 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-eee92b0e-0657-4636-a688-11915f0ae830 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:28.778815 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-eee92b0e-0657-4636-a688-11915f0ae830 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:28.780579 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-eee92b0e-0657-4636-a688-11915f0ae830 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:28.782076 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-eee92b0e-0657-4636-a688-11915f0ae830 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1737 microversion: 2.20 time: 0.364676 Aug 10 17:17:28.783120 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 242/469] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:28 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1737 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:29.062813 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8916cf14-9c3c-4b90-a828-2acdb175fd77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:29.064062 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8916cf14-9c3c-4b90-a828-2acdb175fd77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:29.072005 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8916cf14-9c3c-4b90-a828-2acdb175fd77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:29.072773 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8916cf14-9c3c-4b90-a828-2acdb175fd77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:29.073261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8916cf14-9c3c-4b90-a828-2acdb175fd77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:29.074003 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8916cf14-9c3c-4b90-a828-2acdb175fd77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:29.074668 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8916cf14-9c3c-4b90-a828-2acdb175fd77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:29.075093 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8916cf14-9c3c-4b90-a828-2acdb175fd77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:29.124450 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0e31f4a6-ccba-46ee-98a8-b3cdbe4cba60 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:29.124450 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0e31f4a6-ccba-46ee-98a8-b3cdbe4cba60 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:29.130274 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e31f4a6-ccba-46ee-98a8-b3cdbe4cba60 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:29.130816 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e31f4a6-ccba-46ee-98a8-b3cdbe4cba60 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:29.131259 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e31f4a6-ccba-46ee-98a8-b3cdbe4cba60 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:29.132472 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e31f4a6-ccba-46ee-98a8-b3cdbe4cba60 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:29.132933 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e31f4a6-ccba-46ee-98a8-b3cdbe4cba60 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:29.133370 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e31f4a6-ccba-46ee-98a8-b3cdbe4cba60 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:29.359888 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8916cf14-9c3c-4b90-a828-2acdb175fd77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:29.374015 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:29.384526 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8916cf14-9c3c-4b90-a828-2acdb175fd77 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1713 microversion: 2.1 time: 0.328255 Aug 10 17:17:29.404604 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 228/470] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:29 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1713 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:29.410793 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f6109d37-61b7-4800-8dac-3a76d0485bbc tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:29.411739 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f6109d37-61b7-4800-8dac-3a76d0485bbc tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:29.421134 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=6 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:29.423250 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6109d37-61b7-4800-8dac-3a76d0485bbc tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:29.426934 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6109d37-61b7-4800-8dac-3a76d0485bbc tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:29.426934 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6109d37-61b7-4800-8dac-3a76d0485bbc tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:29.426934 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6109d37-61b7-4800-8dac-3a76d0485bbc tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:29.426934 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6109d37-61b7-4800-8dac-3a76d0485bbc tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:29.427360 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6109d37-61b7-4800-8dac-3a76d0485bbc tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:29.453367 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0e31f4a6-ccba-46ee-98a8-b3cdbe4cba60 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:29.463917 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0e31f4a6-ccba-46ee-98a8-b3cdbe4cba60 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.346825 Aug 10 17:17:29.469185 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 243/471] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:29 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:29.486054 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2a77e4c8-34dd-4487-a06a-d04d8f14f64c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:29.487000 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2a77e4c8-34dd-4487-a06a-d04d8f14f64c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:29.506486 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a77e4c8-34dd-4487-a06a-d04d8f14f64c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:29.508093 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a77e4c8-34dd-4487-a06a-d04d8f14f64c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:29.508916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a77e4c8-34dd-4487-a06a-d04d8f14f64c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:29.511225 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a77e4c8-34dd-4487-a06a-d04d8f14f64c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:29.512189 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a77e4c8-34dd-4487-a06a-d04d8f14f64c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:29.512817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a77e4c8-34dd-4487-a06a-d04d8f14f64c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:29.787016 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f6109d37-61b7-4800-8dac-3a76d0485bbc tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:29.800882 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f6109d37-61b7-4800-8dac-3a76d0485bbc tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1278 microversion: 2.1 time: 0.394878 Aug 10 17:17:29.806036 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 229/472] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:29 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1278 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:29.814457 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-dedda794-abd5-445d-8610-446edff1d27c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:29.815889 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-dedda794-abd5-445d-8610-446edff1d27c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:29.822555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2a77e4c8-34dd-4487-a06a-d04d8f14f64c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:29.828310 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dedda794-abd5-445d-8610-446edff1d27c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:29.828997 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dedda794-abd5-445d-8610-446edff1d27c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:29.829602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dedda794-abd5-445d-8610-446edff1d27c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:29.830582 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dedda794-abd5-445d-8610-446edff1d27c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:29.831201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dedda794-abd5-445d-8610-446edff1d27c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:29.831530 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2a77e4c8-34dd-4487-a06a-d04d8f14f64c tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.359692 Aug 10 17:17:29.831995 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dedda794-abd5-445d-8610-446edff1d27c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:29.832118 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 244/473] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:29 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:30.022944 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dedda794-abd5-445d-8610-446edff1d27c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:30.036814 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dedda794-abd5-445d-8610-446edff1d27c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:30.036814 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dedda794-abd5-445d-8610-446edff1d27c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:30.038681 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-dedda794-abd5-445d-8610-446edff1d27c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1737 microversion: 2.20 time: 0.230397 Aug 10 17:17:30.051080 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 230/474] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:29 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1737 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:30.348943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-222a2826-5580-43a7-8d22-f7ce8770407b req-394a3bea-1da3-41ad-b2ac-57e1ceea166d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fd70709-57e7-4c56-8fc9-3b7a4004f4f5", "tag": "9fbbe438-9def-4137-b2cc-411f0ed52ac0"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:30.370555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:30.378493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-222a2826-5580-43a7-8d22-f7ce8770407b req-394a3bea-1da3-41ad-b2ac-57e1ceea166d service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:30.383128 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-222a2826-5580-43a7-8d22-f7ce8770407b req-394a3bea-1da3-41ad-b2ac-57e1ceea166d service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:30.387031 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-222a2826-5580-43a7-8d22-f7ce8770407b req-394a3bea-1da3-41ad-b2ac-57e1ceea166d service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:30.422459 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-222a2826-5580-43a7-8d22-f7ce8770407b req-394a3bea-1da3-41ad-b2ac-57e1ceea166d service nova] Creating event network-changed:9fbbe438-9def-4137-b2cc-411f0ed52ac0 for instance 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 on hv-cinder-85272 Aug 10 17:17:30.422459 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-222a2826-5580-43a7-8d22-f7ce8770407b req-394a3bea-1da3-41ad-b2ac-57e1ceea166d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076183 Aug 10 17:17:30.423498 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 245/475] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:17:30.493623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c76dc5d1-c96a-47a2-b8d1-1cf8e50d0af8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:30.494599 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c76dc5d1-c96a-47a2-b8d1-1cf8e50d0af8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:30.505596 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c76dc5d1-c96a-47a2-b8d1-1cf8e50d0af8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:30.506678 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c76dc5d1-c96a-47a2-b8d1-1cf8e50d0af8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:30.508387 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c76dc5d1-c96a-47a2-b8d1-1cf8e50d0af8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:30.510394 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c76dc5d1-c96a-47a2-b8d1-1cf8e50d0af8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:30.511482 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c76dc5d1-c96a-47a2-b8d1-1cf8e50d0af8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:30.512077 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c76dc5d1-c96a-47a2-b8d1-1cf8e50d0af8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:30.718315 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c76dc5d1-c96a-47a2-b8d1-1cf8e50d0af8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:30.743968 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c76dc5d1-c96a-47a2-b8d1-1cf8e50d0af8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.252118 Aug 10 17:17:30.743968 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 231/476] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:30 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:30.827930 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-69492e34-f6bb-4f82-adb3-0750a1b58950 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:30.828720 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-69492e34-f6bb-4f82-adb3-0750a1b58950 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:30.839132 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69492e34-f6bb-4f82-adb3-0750a1b58950 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:30.840301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69492e34-f6bb-4f82-adb3-0750a1b58950 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:30.841306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69492e34-f6bb-4f82-adb3-0750a1b58950 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:30.847815 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69492e34-f6bb-4f82-adb3-0750a1b58950 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:30.849117 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69492e34-f6bb-4f82-adb3-0750a1b58950 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:30.850100 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69492e34-f6bb-4f82-adb3-0750a1b58950 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:30.862127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d0c3f970-52cb-4a3d-95bf-56e778ce931b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:30.863065 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d0c3f970-52cb-4a3d-95bf-56e778ce931b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:30.871624 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d0c3f970-52cb-4a3d-95bf-56e778ce931b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:30.872419 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d0c3f970-52cb-4a3d-95bf-56e778ce931b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:30.872857 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d0c3f970-52cb-4a3d-95bf-56e778ce931b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:30.873752 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d0c3f970-52cb-4a3d-95bf-56e778ce931b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:30.874216 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d0c3f970-52cb-4a3d-95bf-56e778ce931b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:30.874675 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d0c3f970-52cb-4a3d-95bf-56e778ce931b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:31.091874 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d0c3f970-52cb-4a3d-95bf-56e778ce931b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:31.096854 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-69492e34-f6bb-4f82-adb3-0750a1b58950 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:31.103868 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d0c3f970-52cb-4a3d-95bf-56e778ce931b tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.246439 Aug 10 17:17:31.105152 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 232/477] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:30 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:31.106856 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-69492e34-f6bb-4f82-adb3-0750a1b58950 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1266 microversion: 2.1 time: 0.283189 Aug 10 17:17:31.110966 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-dfa3735d-bad1-4a6a-a156-95c0bdd70928 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:31.111986 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 246/478] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:30 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:31.112458 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-dfa3735d-bad1-4a6a-a156-95c0bdd70928 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:31.120043 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dfa3735d-bad1-4a6a-a156-95c0bdd70928 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:31.120880 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dfa3735d-bad1-4a6a-a156-95c0bdd70928 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:31.121620 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dfa3735d-bad1-4a6a-a156-95c0bdd70928 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:31.122469 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dfa3735d-bad1-4a6a-a156-95c0bdd70928 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:31.123004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dfa3735d-bad1-4a6a-a156-95c0bdd70928 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:31.123542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dfa3735d-bad1-4a6a-a156-95c0bdd70928 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:31.259222 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dfa3735d-bad1-4a6a-a156-95c0bdd70928 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:31.267516 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dfa3735d-bad1-4a6a-a156-95c0bdd70928 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:31.269663 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dfa3735d-bad1-4a6a-a156-95c0bdd70928 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:31.270876 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-dfa3735d-bad1-4a6a-a156-95c0bdd70928 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1737 microversion: 2.20 time: 0.164552 Aug 10 17:17:31.271420 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 233/479] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:31 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:31.762480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-78572bf0-b3d6-4371-9eee-7641e5f30506 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:31.763186 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-78572bf0-b3d6-4371-9eee-7641e5f30506 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:31.772167 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78572bf0-b3d6-4371-9eee-7641e5f30506 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:31.772706 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78572bf0-b3d6-4371-9eee-7641e5f30506 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:31.776828 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78572bf0-b3d6-4371-9eee-7641e5f30506 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:31.777818 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78572bf0-b3d6-4371-9eee-7641e5f30506 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:31.778528 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78572bf0-b3d6-4371-9eee-7641e5f30506 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:31.780915 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78572bf0-b3d6-4371-9eee-7641e5f30506 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:31.951231 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-78572bf0-b3d6-4371-9eee-7641e5f30506 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:31.960624 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-78572bf0-b3d6-4371-9eee-7641e5f30506 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.202084 Aug 10 17:17:31.962128 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 247/480] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:31 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:32.126880 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1f1abc35-33d4-427d-9457-885aaed77df7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:32.128202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1f1abc35-33d4-427d-9457-885aaed77df7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:32.132223 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e4ea2bf2-3b66-4cf2-af58-c9ad4d31f9e3 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:32.133034 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e4ea2bf2-3b66-4cf2-af58-c9ad4d31f9e3 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:32.143783 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f1abc35-33d4-427d-9457-885aaed77df7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:32.145825 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e4ea2bf2-3b66-4cf2-af58-c9ad4d31f9e3 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:32.146062 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f1abc35-33d4-427d-9457-885aaed77df7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:32.147230 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f1abc35-33d4-427d-9457-885aaed77df7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:32.147754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e4ea2bf2-3b66-4cf2-af58-c9ad4d31f9e3 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:32.148754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e4ea2bf2-3b66-4cf2-af58-c9ad4d31f9e3 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:32.149663 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e4ea2bf2-3b66-4cf2-af58-c9ad4d31f9e3 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:32.150439 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e4ea2bf2-3b66-4cf2-af58-c9ad4d31f9e3 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:32.151067 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e4ea2bf2-3b66-4cf2-af58-c9ad4d31f9e3 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:32.151354 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f1abc35-33d4-427d-9457-885aaed77df7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:32.151833 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f1abc35-33d4-427d-9457-885aaed77df7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:32.152294 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f1abc35-33d4-427d-9457-885aaed77df7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:32.418534 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e4ea2bf2-3b66-4cf2-af58-c9ad4d31f9e3 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:32.426926 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e4ea2bf2-3b66-4cf2-af58-c9ad4d31f9e3 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1266 microversion: 2.1 time: 0.300011 Aug 10 17:17:32.432158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 248/481] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:32 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:32.444906 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1f1abc35-33d4-427d-9457-885aaed77df7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:32.458259 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-05e260ba-aad1-4031-99a1-b1040cbd9c3d req-5a4516a6-a6ea-4185-bdd3-611fbe2ab997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a02347-095c-4aa2-92b0-5bcdf5fce2a9", "name": "network-vif-plugged", "status": "completed", "tag": "f75a7b46-ae6b-4d8e-bf2e-f099e435733a"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:32.458932 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1f1abc35-33d4-427d-9457-885aaed77df7 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.332782 Aug 10 17:17:32.458932 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 234/482] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:32 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:32.462144 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7363047a-628e-4d0c-93d6-1b776d183add tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:32.463051 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7363047a-628e-4d0c-93d6-1b776d183add tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:32.464045 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-05e260ba-aad1-4031-99a1-b1040cbd9c3d req-5a4516a6-a6ea-4185-bdd3-611fbe2ab997 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:32.464722 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-05e260ba-aad1-4031-99a1-b1040cbd9c3d req-5a4516a6-a6ea-4185-bdd3-611fbe2ab997 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:32.465190 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-05e260ba-aad1-4031-99a1-b1040cbd9c3d req-5a4516a6-a6ea-4185-bdd3-611fbe2ab997 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:32.480262 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7363047a-628e-4d0c-93d6-1b776d183add tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:32.480762 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7363047a-628e-4d0c-93d6-1b776d183add tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:32.481202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7363047a-628e-4d0c-93d6-1b776d183add tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:32.481919 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7363047a-628e-4d0c-93d6-1b776d183add tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:32.482387 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7363047a-628e-4d0c-93d6-1b776d183add tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:32.482825 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7363047a-628e-4d0c-93d6-1b776d183add tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:32.493792 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-05e260ba-aad1-4031-99a1-b1040cbd9c3d req-5a4516a6-a6ea-4185-bdd3-611fbe2ab997 service nova] Creating event network-vif-plugged:f75a7b46-ae6b-4d8e-bf2e-f099e435733a for instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 on hv-cinder-85272 Aug 10 17:17:32.501744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-05e260ba-aad1-4031-99a1-b1040cbd9c3d req-5a4516a6-a6ea-4185-bdd3-611fbe2ab997 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067876 Aug 10 17:17:32.502253 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 249/483] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:17:32.685593 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7363047a-628e-4d0c-93d6-1b776d183add tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:32.694926 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7363047a-628e-4d0c-93d6-1b776d183add tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:32.699810 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7363047a-628e-4d0c-93d6-1b776d183add tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:32.701086 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7363047a-628e-4d0c-93d6-1b776d183add tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1737 microversion: 2.20 time: 0.244272 Aug 10 17:17:32.702152 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 235/484] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:32 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1737 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:32.988491 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b99c3ff5-2929-4793-aa34-61537efdfd23 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:32.989847 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b99c3ff5-2929-4793-aa34-61537efdfd23 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:33.012762 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b99c3ff5-2929-4793-aa34-61537efdfd23 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:33.013800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b99c3ff5-2929-4793-aa34-61537efdfd23 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:33.014715 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b99c3ff5-2929-4793-aa34-61537efdfd23 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:33.017301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b99c3ff5-2929-4793-aa34-61537efdfd23 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:33.018215 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b99c3ff5-2929-4793-aa34-61537efdfd23 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:33.021828 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b99c3ff5-2929-4793-aa34-61537efdfd23 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:33.241470 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b99c3ff5-2929-4793-aa34-61537efdfd23 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:33.245621 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:33.250588 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b99c3ff5-2929-4793-aa34-61537efdfd23 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.267230 Aug 10 17:17:33.251178 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 250/485] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:32 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:33.450503 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e466d7ac-82f7-43a8-a88c-6e6b283b46a2 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:33.451830 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e466d7ac-82f7-43a8-a88c-6e6b283b46a2 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:33.460203 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e466d7ac-82f7-43a8-a88c-6e6b283b46a2 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:33.461307 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e466d7ac-82f7-43a8-a88c-6e6b283b46a2 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:33.461915 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e466d7ac-82f7-43a8-a88c-6e6b283b46a2 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:33.462984 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e466d7ac-82f7-43a8-a88c-6e6b283b46a2 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:33.463600 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e466d7ac-82f7-43a8-a88c-6e6b283b46a2 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:33.464263 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e466d7ac-82f7-43a8-a88c-6e6b283b46a2 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:33.481561 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b49d036a-74c8-4213-9757-e26d5402819e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:33.482194 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b49d036a-74c8-4213-9757-e26d5402819e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:33.495407 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b49d036a-74c8-4213-9757-e26d5402819e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:33.498232 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b49d036a-74c8-4213-9757-e26d5402819e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:33.498757 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b49d036a-74c8-4213-9757-e26d5402819e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:33.499563 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b49d036a-74c8-4213-9757-e26d5402819e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:33.500032 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b49d036a-74c8-4213-9757-e26d5402819e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:33.500519 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b49d036a-74c8-4213-9757-e26d5402819e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:33.742207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e466d7ac-82f7-43a8-a88c-6e6b283b46a2 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:33.745706 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b49d036a-74c8-4213-9757-e26d5402819e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:33.754662 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e466d7ac-82f7-43a8-a88c-6e6b283b46a2 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1266 microversion: 2.1 time: 0.308833 Aug 10 17:17:33.759677 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b49d036a-74c8-4213-9757-e26d5402819e tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.284743 Aug 10 17:17:33.774957 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 236/486] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:33 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1266 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:33.778573 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 251/487] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:33 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:33.783738 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0e36bb97-0f45-4ed4-bd89-858b2556d0bf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:33.792898 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0e36bb97-0f45-4ed4-bd89-858b2556d0bf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:33.817872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0e36bb97-0f45-4ed4-bd89-858b2556d0bf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:33.825881 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0e36bb97-0f45-4ed4-bd89-858b2556d0bf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:33.826344 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0e36bb97-0f45-4ed4-bd89-858b2556d0bf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:33.848792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0e36bb97-0f45-4ed4-bd89-858b2556d0bf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:33.848792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0e36bb97-0f45-4ed4-bd89-858b2556d0bf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:33.848792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0e36bb97-0f45-4ed4-bd89-858b2556d0bf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:34.016286 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0e36bb97-0f45-4ed4-bd89-858b2556d0bf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:34.026743 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0e36bb97-0f45-4ed4-bd89-858b2556d0bf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:34.028567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0e36bb97-0f45-4ed4-bd89-858b2556d0bf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:34.029910 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0e36bb97-0f45-4ed4-bd89-858b2556d0bf tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1737 microversion: 2.20 time: 0.253067 Aug 10 17:17:34.030987 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 237/488] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:33 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1737 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:34.272518 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-db33afa6-aa6c-4db3-bf31-81d6ab1f71f0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:34.274319 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-db33afa6-aa6c-4db3-bf31-81d6ab1f71f0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:34.283095 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db33afa6-aa6c-4db3-bf31-81d6ab1f71f0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:34.283978 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db33afa6-aa6c-4db3-bf31-81d6ab1f71f0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:34.284511 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db33afa6-aa6c-4db3-bf31-81d6ab1f71f0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:34.285353 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db33afa6-aa6c-4db3-bf31-81d6ab1f71f0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:34.285864 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db33afa6-aa6c-4db3-bf31-81d6ab1f71f0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:34.286522 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db33afa6-aa6c-4db3-bf31-81d6ab1f71f0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:34.456398 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-db33afa6-aa6c-4db3-bf31-81d6ab1f71f0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:34.466746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-db33afa6-aa6c-4db3-bf31-81d6ab1f71f0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.197361 Aug 10 17:17:34.469878 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 252/489] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:34 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:34.550089 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-d68b1c2b-d6cc-46b1-9d32-32001aad92de req-b6bb402f-9555-4ccb-a09e-4146173cabb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b896ebbd-8a0c-4729-98e4-e27e38e70856", "name": "network-vif-plugged", "status": "completed", "tag": "8231cc59-a495-4ec2-b108-a116409f6427"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:34.561400 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-d68b1c2b-d6cc-46b1-9d32-32001aad92de req-b6bb402f-9555-4ccb-a09e-4146173cabb7 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:34.562192 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-d68b1c2b-d6cc-46b1-9d32-32001aad92de req-b6bb402f-9555-4ccb-a09e-4146173cabb7 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:34.562837 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-d68b1c2b-d6cc-46b1-9d32-32001aad92de req-b6bb402f-9555-4ccb-a09e-4146173cabb7 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:34.580812 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-d68b1c2b-d6cc-46b1-9d32-32001aad92de req-b6bb402f-9555-4ccb-a09e-4146173cabb7 service nova] Creating event network-vif-plugged:8231cc59-a495-4ec2-b108-a116409f6427 for instance b896ebbd-8a0c-4729-98e4-e27e38e70856 on hv-cinder-85272 Aug 10 17:17:34.587419 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-d68b1c2b-d6cc-46b1-9d32-32001aad92de req-b6bb402f-9555-4ccb-a09e-4146173cabb7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041641 Aug 10 17:17:34.588028 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 238/490] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:17:34.806903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3d979212-991a-4ed4-82db-bdb0c5edaf3c tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:34.807205 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3d405be7-93fd-4db9-9e4f-83bd81a258ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:34.807475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3d979212-991a-4ed4-82db-bdb0c5edaf3c tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:34.807879 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3d405be7-93fd-4db9-9e4f-83bd81a258ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:34.810903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:34.816165 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d979212-991a-4ed4-82db-bdb0c5edaf3c tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:34.816671 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d979212-991a-4ed4-82db-bdb0c5edaf3c tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:34.817110 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d979212-991a-4ed4-82db-bdb0c5edaf3c tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:34.817446 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d405be7-93fd-4db9-9e4f-83bd81a258ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:34.817829 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d979212-991a-4ed4-82db-bdb0c5edaf3c tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:34.817968 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d405be7-93fd-4db9-9e4f-83bd81a258ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:34.818282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d979212-991a-4ed4-82db-bdb0c5edaf3c tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:34.818428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d405be7-93fd-4db9-9e4f-83bd81a258ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:34.818752 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d979212-991a-4ed4-82db-bdb0c5edaf3c tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:34.820205 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d405be7-93fd-4db9-9e4f-83bd81a258ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:34.820688 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d405be7-93fd-4db9-9e4f-83bd81a258ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:34.821125 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d405be7-93fd-4db9-9e4f-83bd81a258ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:35.026858 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3d405be7-93fd-4db9-9e4f-83bd81a258ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:35.030571 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3d979212-991a-4ed4-82db-bdb0c5edaf3c tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:35.034584 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3d405be7-93fd-4db9-9e4f-83bd81a258ce tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.250033 Aug 10 17:17:35.035392 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 239/491] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:34 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:35.038998 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3d979212-991a-4ed4-82db-bdb0c5edaf3c tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1266 microversion: 2.1 time: 0.265435 Aug 10 17:17:35.039583 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 253/492] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:34 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:35.061537 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-befb8227-c54d-4469-8e32-880966959d99 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:35.062130 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-befb8227-c54d-4469-8e32-880966959d99 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:35.068302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-befb8227-c54d-4469-8e32-880966959d99 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:35.068892 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-befb8227-c54d-4469-8e32-880966959d99 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:35.070515 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-befb8227-c54d-4469-8e32-880966959d99 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:35.071244 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-befb8227-c54d-4469-8e32-880966959d99 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:35.071750 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-befb8227-c54d-4469-8e32-880966959d99 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:35.072178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-befb8227-c54d-4469-8e32-880966959d99 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:35.207222 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-befb8227-c54d-4469-8e32-880966959d99 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:35.216043 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-befb8227-c54d-4469-8e32-880966959d99 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:35.217535 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-befb8227-c54d-4469-8e32-880966959d99 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:35.218712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-befb8227-c54d-4469-8e32-880966959d99 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1737 microversion: 2.20 time: 0.161711 Aug 10 17:17:35.219737 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 240/493] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:35 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:35.493570 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fd0ec49f-fc22-40b4-aa8c-7ff626962038 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:35.496621 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fd0ec49f-fc22-40b4-aa8c-7ff626962038 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:35.504373 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fd0ec49f-fc22-40b4-aa8c-7ff626962038 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:35.504972 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fd0ec49f-fc22-40b4-aa8c-7ff626962038 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:35.505490 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fd0ec49f-fc22-40b4-aa8c-7ff626962038 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:35.506528 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fd0ec49f-fc22-40b4-aa8c-7ff626962038 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:35.507088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fd0ec49f-fc22-40b4-aa8c-7ff626962038 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:35.507581 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fd0ec49f-fc22-40b4-aa8c-7ff626962038 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:35.752323 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fd0ec49f-fc22-40b4-aa8c-7ff626962038 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:35.766228 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fd0ec49f-fc22-40b4-aa8c-7ff626962038 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1369 microversion: 2.1 time: 0.277325 Aug 10 17:17:35.767437 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 254/494] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:35 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1369 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:36.062401 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3e4b2da0-71ac-4fe4-9d29-a644b26043fd tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:36.067130 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4e225e35-6d9e-4000-9db8-3199e93d2913 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:36.068531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4e225e35-6d9e-4000-9db8-3199e93d2913 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:36.070342 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3e4b2da0-71ac-4fe4-9d29-a644b26043fd tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:36.101044 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e225e35-6d9e-4000-9db8-3199e93d2913 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:36.101222 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e4b2da0-71ac-4fe4-9d29-a644b26043fd tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:36.101222 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e4b2da0-71ac-4fe4-9d29-a644b26043fd tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:36.101222 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e4b2da0-71ac-4fe4-9d29-a644b26043fd tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:36.101222 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e4b2da0-71ac-4fe4-9d29-a644b26043fd tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:36.101698 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e4b2da0-71ac-4fe4-9d29-a644b26043fd tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:36.101698 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e4b2da0-71ac-4fe4-9d29-a644b26043fd tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:36.101939 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e225e35-6d9e-4000-9db8-3199e93d2913 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:36.101939 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e225e35-6d9e-4000-9db8-3199e93d2913 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:36.101939 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e225e35-6d9e-4000-9db8-3199e93d2913 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:36.101939 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e225e35-6d9e-4000-9db8-3199e93d2913 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:36.102564 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e225e35-6d9e-4000-9db8-3199e93d2913 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:36.122178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:36.377388 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4e225e35-6d9e-4000-9db8-3199e93d2913 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:36.391832 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4e225e35-6d9e-4000-9db8-3199e93d2913 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1266 microversion: 2.1 time: 0.335539 Aug 10 17:17:36.393236 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 241/495] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:36 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:36.401427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-40c03507-f3e3-42de-a8aa-c69ba726650b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:36.402757 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3e4b2da0-71ac-4fe4-9d29-a644b26043fd tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:36.403141 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-40c03507-f3e3-42de-a8aa-c69ba726650b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:36.411707 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40c03507-f3e3-42de-a8aa-c69ba726650b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:36.411938 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3e4b2da0-71ac-4fe4-9d29-a644b26043fd tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.354175 Aug 10 17:17:36.413217 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40c03507-f3e3-42de-a8aa-c69ba726650b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:36.422798 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 255/496] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:36 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:36.424685 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40c03507-f3e3-42de-a8aa-c69ba726650b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:36.425703 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40c03507-f3e3-42de-a8aa-c69ba726650b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:36.426176 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40c03507-f3e3-42de-a8aa-c69ba726650b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:36.427174 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40c03507-f3e3-42de-a8aa-c69ba726650b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:36.587794 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-40c03507-f3e3-42de-a8aa-c69ba726650b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:36.596554 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-40c03507-f3e3-42de-a8aa-c69ba726650b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:36.598250 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-40c03507-f3e3-42de-a8aa-c69ba726650b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:36.599466 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-40c03507-f3e3-42de-a8aa-c69ba726650b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1737 microversion: 2.20 time: 0.204546 Aug 10 17:17:36.600543 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 242/497] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:36 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:36.791860 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a771a4da-0e7d-45ad-8ea3-c6a6effdb5ec tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:36.793207 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a771a4da-0e7d-45ad-8ea3-c6a6effdb5ec tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:36.803541 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a771a4da-0e7d-45ad-8ea3-c6a6effdb5ec tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:36.805958 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a771a4da-0e7d-45ad-8ea3-c6a6effdb5ec tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:36.806432 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a771a4da-0e7d-45ad-8ea3-c6a6effdb5ec tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:36.807157 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a771a4da-0e7d-45ad-8ea3-c6a6effdb5ec tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:36.807953 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a771a4da-0e7d-45ad-8ea3-c6a6effdb5ec tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:36.809357 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a771a4da-0e7d-45ad-8ea3-c6a6effdb5ec tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:37.035701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a771a4da-0e7d-45ad-8ea3-c6a6effdb5ec tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:37.038552 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a771a4da-0e7d-45ad-8ea3-c6a6effdb5ec tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1563 microversion: 2.1 time: 0.252488 Aug 10 17:17:37.040056 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 256/498] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:36 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:37.061328 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-149b1b5e-b2fb-4fa3-a3f1-469fee381c79 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:37.064277 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-149b1b5e-b2fb-4fa3-a3f1-469fee381c79 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:37.073601 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-149b1b5e-b2fb-4fa3-a3f1-469fee381c79 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:37.076328 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-149b1b5e-b2fb-4fa3-a3f1-469fee381c79 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:37.077131 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-149b1b5e-b2fb-4fa3-a3f1-469fee381c79 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:37.078544 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-149b1b5e-b2fb-4fa3-a3f1-469fee381c79 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:37.079247 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-149b1b5e-b2fb-4fa3-a3f1-469fee381c79 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:37.079679 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-149b1b5e-b2fb-4fa3-a3f1-469fee381c79 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:37.185448 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-149b1b5e-b2fb-4fa3-a3f1-469fee381c79 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128364 Aug 10 17:17:37.193784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 243/499] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 17:17:37 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:17:37.413658 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-47562aab-b34c-4d6e-9f9d-f559abeb8b60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:37.414281 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-47562aab-b34c-4d6e-9f9d-f559abeb8b60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:37.434059 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4fbca7ec-db56-4ba4-834b-1a7a4bef9aea tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:37.434712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4fbca7ec-db56-4ba4-834b-1a7a4bef9aea tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:37.438430 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-47562aab-b34c-4d6e-9f9d-f559abeb8b60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:37.440582 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-47562aab-b34c-4d6e-9f9d-f559abeb8b60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:37.441253 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-47562aab-b34c-4d6e-9f9d-f559abeb8b60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:37.442284 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-47562aab-b34c-4d6e-9f9d-f559abeb8b60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:37.445110 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4fbca7ec-db56-4ba4-834b-1a7a4bef9aea tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:37.445643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4fbca7ec-db56-4ba4-834b-1a7a4bef9aea tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:37.446078 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4fbca7ec-db56-4ba4-834b-1a7a4bef9aea tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:37.446388 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-47562aab-b34c-4d6e-9f9d-f559abeb8b60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:37.446907 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-47562aab-b34c-4d6e-9f9d-f559abeb8b60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:37.452324 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4fbca7ec-db56-4ba4-834b-1a7a4bef9aea tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:37.452808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4fbca7ec-db56-4ba4-834b-1a7a4bef9aea tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:37.453249 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4fbca7ec-db56-4ba4-834b-1a7a4bef9aea tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:37.745693 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4fbca7ec-db56-4ba4-834b-1a7a4bef9aea tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:37.758779 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4fbca7ec-db56-4ba4-834b-1a7a4bef9aea tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.328577 Aug 10 17:17:37.774076 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 244/500] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:37 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:37.774076 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c86b9844-c59b-4401-862f-dda625c144fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:37.774076 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c86b9844-c59b-4401-862f-dda625c144fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:37.790915 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c86b9844-c59b-4401-862f-dda625c144fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:37.795513 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c86b9844-c59b-4401-862f-dda625c144fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:37.795513 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c86b9844-c59b-4401-862f-dda625c144fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:37.795513 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c86b9844-c59b-4401-862f-dda625c144fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:37.795513 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c86b9844-c59b-4401-862f-dda625c144fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:37.795900 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c86b9844-c59b-4401-862f-dda625c144fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:37.797070 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-47562aab-b34c-4d6e-9f9d-f559abeb8b60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:37.810189 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-47562aab-b34c-4d6e-9f9d-f559abeb8b60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1266 microversion: 2.1 time: 0.400867 Aug 10 17:17:37.824810 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 257/501] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:37 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1266 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:37.970862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c86b9844-c59b-4401-862f-dda625c144fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:37.980241 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c86b9844-c59b-4401-862f-dda625c144fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:37.982061 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c86b9844-c59b-4401-862f-dda625c144fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:37.983715 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c86b9844-c59b-4401-862f-dda625c144fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1737 microversion: 2.20 time: 0.223257 Aug 10 17:17:37.984821 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 245/502] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:37 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:38.786421 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4ea3a385-1cd0-458f-ba26-cd3630ad24ed tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:38.786998 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4ea3a385-1cd0-458f-ba26-cd3630ad24ed tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:38.793079 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ea3a385-1cd0-458f-ba26-cd3630ad24ed tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:38.793559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ea3a385-1cd0-458f-ba26-cd3630ad24ed tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:38.793997 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ea3a385-1cd0-458f-ba26-cd3630ad24ed tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:38.794723 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ea3a385-1cd0-458f-ba26-cd3630ad24ed tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:38.795631 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ea3a385-1cd0-458f-ba26-cd3630ad24ed tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:38.795732 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ea3a385-1cd0-458f-ba26-cd3630ad24ed tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:38.839407 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-4e94c3e7-5e65-4dc1-8b4f-661e4dd00695 req-3aa58f87-2832-403b-9b7b-96c527ec0448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a02347-095c-4aa2-92b0-5bcdf5fce2a9", "tag": "f75a7b46-ae6b-4d8e-bf2e-f099e435733a"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:38.852926 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-4e94c3e7-5e65-4dc1-8b4f-661e4dd00695 req-3aa58f87-2832-403b-9b7b-96c527ec0448 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:38.854172 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-4e94c3e7-5e65-4dc1-8b4f-661e4dd00695 req-3aa58f87-2832-403b-9b7b-96c527ec0448 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:38.854172 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-4e94c3e7-5e65-4dc1-8b4f-661e4dd00695 req-3aa58f87-2832-403b-9b7b-96c527ec0448 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:38.867074 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-4e94c3e7-5e65-4dc1-8b4f-661e4dd00695 req-3aa58f87-2832-403b-9b7b-96c527ec0448 service nova] Creating event network-changed:f75a7b46-ae6b-4d8e-bf2e-f099e435733a for instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 on hv-cinder-85272 Aug 10 17:17:38.886800 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-4e94c3e7-5e65-4dc1-8b4f-661e4dd00695 req-3aa58f87-2832-403b-9b7b-96c527ec0448 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057365 Aug 10 17:17:38.888091 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 246/503] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:17:38.894455 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4146aef3-5a2c-4fd0-ab1f-23281dbbad63 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:38.895344 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4146aef3-5a2c-4fd0-ab1f-23281dbbad63 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:38.902454 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4146aef3-5a2c-4fd0-ab1f-23281dbbad63 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:38.903314 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4146aef3-5a2c-4fd0-ab1f-23281dbbad63 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:38.904801 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4146aef3-5a2c-4fd0-ab1f-23281dbbad63 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:38.905653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4146aef3-5a2c-4fd0-ab1f-23281dbbad63 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:38.906227 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4146aef3-5a2c-4fd0-ab1f-23281dbbad63 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:38.906792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4146aef3-5a2c-4fd0-ab1f-23281dbbad63 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:38.959143 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4ea3a385-1cd0-458f-ba26-cd3630ad24ed tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:38.968293 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4ea3a385-1cd0-458f-ba26-cd3630ad24ed tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1313 microversion: 2.1 time: 0.185752 Aug 10 17:17:38.969205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 258/504] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:38 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:39.014343 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-92aa64cf-1c4a-4b88-9917-9c8d54f81485 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:39.015285 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-92aa64cf-1c4a-4b88-9917-9c8d54f81485 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:39.022010 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92aa64cf-1c4a-4b88-9917-9c8d54f81485 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:39.022555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92aa64cf-1c4a-4b88-9917-9c8d54f81485 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:39.023279 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92aa64cf-1c4a-4b88-9917-9c8d54f81485 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:39.023993 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92aa64cf-1c4a-4b88-9917-9c8d54f81485 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:39.024499 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92aa64cf-1c4a-4b88-9917-9c8d54f81485 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:39.024866 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92aa64cf-1c4a-4b88-9917-9c8d54f81485 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:39.119177 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4146aef3-5a2c-4fd0-ab1f-23281dbbad63 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:39.126700 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4146aef3-5a2c-4fd0-ab1f-23281dbbad63 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1266 microversion: 2.1 time: 0.237077 Aug 10 17:17:39.127793 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 247/505] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:38 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:39.191719 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-92aa64cf-1c4a-4b88-9917-9c8d54f81485 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:39.206504 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-92aa64cf-1c4a-4b88-9917-9c8d54f81485 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:39.208610 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-92aa64cf-1c4a-4b88-9917-9c8d54f81485 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:39.210219 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-92aa64cf-1c4a-4b88-9917-9c8d54f81485 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1737 microversion: 2.20 time: 0.201484 Aug 10 17:17:39.210822 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 259/506] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:39 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:39.989752 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-eb087ac3-50aa-47bf-92ab-973bc154bd74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:39.993204 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-eb087ac3-50aa-47bf-92ab-973bc154bd74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:40.020815 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eb087ac3-50aa-47bf-92ab-973bc154bd74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:40.021326 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eb087ac3-50aa-47bf-92ab-973bc154bd74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:40.022128 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eb087ac3-50aa-47bf-92ab-973bc154bd74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:40.023061 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eb087ac3-50aa-47bf-92ab-973bc154bd74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:40.023535 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eb087ac3-50aa-47bf-92ab-973bc154bd74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:40.024256 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eb087ac3-50aa-47bf-92ab-973bc154bd74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:40.152180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-34a59f79-6e66-488b-94d3-848a778351d8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:40.152909 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-34a59f79-6e66-488b-94d3-848a778351d8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:40.169589 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34a59f79-6e66-488b-94d3-848a778351d8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:40.172232 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34a59f79-6e66-488b-94d3-848a778351d8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:40.172886 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34a59f79-6e66-488b-94d3-848a778351d8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:40.174472 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34a59f79-6e66-488b-94d3-848a778351d8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:40.175151 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34a59f79-6e66-488b-94d3-848a778351d8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:40.176914 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34a59f79-6e66-488b-94d3-848a778351d8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:40.462289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-eb087ac3-50aa-47bf-92ab-973bc154bd74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:40.480898 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-eb087ac3-50aa-47bf-92ab-973bc154bd74 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1495 microversion: 2.1 time: 0.495606 Aug 10 17:17:40.493056 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 248/507] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:39 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1495 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:40.493056 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-43981d74-8260-439a-ac25-2ef3cc86226a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:40.493056 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-43981d74-8260-439a-ac25-2ef3cc86226a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:40.500093 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-43981d74-8260-439a-ac25-2ef3cc86226a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:40.500093 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-43981d74-8260-439a-ac25-2ef3cc86226a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:40.500093 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-43981d74-8260-439a-ac25-2ef3cc86226a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:40.500093 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-43981d74-8260-439a-ac25-2ef3cc86226a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:40.500418 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-43981d74-8260-439a-ac25-2ef3cc86226a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:40.500418 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-43981d74-8260-439a-ac25-2ef3cc86226a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:40.567002 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-34a59f79-6e66-488b-94d3-848a778351d8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:40.575042 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-34a59f79-6e66-488b-94d3-848a778351d8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1266 microversion: 2.1 time: 0.429872 Aug 10 17:17:40.575631 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 260/508] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:40 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1266 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:40.666106 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-43981d74-8260-439a-ac25-2ef3cc86226a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:40.674204 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-43981d74-8260-439a-ac25-2ef3cc86226a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:40.675733 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-43981d74-8260-439a-ac25-2ef3cc86226a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:40.677210 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-43981d74-8260-439a-ac25-2ef3cc86226a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1737 microversion: 2.20 time: 0.194029 Aug 10 17:17:40.679730 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 249/509] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:40 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:41.597551 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e028da3a-096f-4c96-9893-5a56ee6e6327 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:41.598167 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e028da3a-096f-4c96-9893-5a56ee6e6327 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:41.608161 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e028da3a-096f-4c96-9893-5a56ee6e6327 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:41.608161 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e028da3a-096f-4c96-9893-5a56ee6e6327 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:41.608161 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e028da3a-096f-4c96-9893-5a56ee6e6327 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:41.608161 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e028da3a-096f-4c96-9893-5a56ee6e6327 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:41.608561 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e028da3a-096f-4c96-9893-5a56ee6e6327 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:41.608561 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e028da3a-096f-4c96-9893-5a56ee6e6327 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:41.700696 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4c453d29-4233-489a-b38d-0f7ab1c268c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:41.701306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4c453d29-4233-489a-b38d-0f7ab1c268c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:41.708251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4c453d29-4233-489a-b38d-0f7ab1c268c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:41.708737 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4c453d29-4233-489a-b38d-0f7ab1c268c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:41.709734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4c453d29-4233-489a-b38d-0f7ab1c268c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:41.710667 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4c453d29-4233-489a-b38d-0f7ab1c268c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:41.711287 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4c453d29-4233-489a-b38d-0f7ab1c268c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:41.711917 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4c453d29-4233-489a-b38d-0f7ab1c268c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:41.813788 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e028da3a-096f-4c96-9893-5a56ee6e6327 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:41.822395 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e028da3a-096f-4c96-9893-5a56ee6e6327 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1266 microversion: 2.1 time: 0.230099 Aug 10 17:17:41.823333 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 261/510] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:41 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:41.883938 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4c453d29-4233-489a-b38d-0f7ab1c268c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:41.892811 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4c453d29-4233-489a-b38d-0f7ab1c268c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:41.894413 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4c453d29-4233-489a-b38d-0f7ab1c268c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:41.895655 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4c453d29-4233-489a-b38d-0f7ab1c268c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1737 microversion: 2.20 time: 0.198880 Aug 10 17:17:41.896218 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 250/511] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:41 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:17:42.033803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-667be983-e184-4405-bc0d-883cb00000d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:42.034299 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-667be983-e184-4405-bc0d-883cb00000d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:42.041501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-667be983-e184-4405-bc0d-883cb00000d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:42.042129 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-667be983-e184-4405-bc0d-883cb00000d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:42.042494 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-667be983-e184-4405-bc0d-883cb00000d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:42.043199 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-667be983-e184-4405-bc0d-883cb00000d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:42.043656 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-667be983-e184-4405-bc0d-883cb00000d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:42.044084 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-667be983-e184-4405-bc0d-883cb00000d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:42.069420 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-667be983-e184-4405-bc0d-883cb00000d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:17:42.433438 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-667be983-e184-4405-bc0d-883cb00000d9 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 204 len: 0 microversion: 2.1 time: 0.403376 Aug 10 17:17:42.434035 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 262/512] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:17:42 2022] DELETE /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:17:42.442036 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-27e06d8e-c041-4de7-b7a8-ed28013e9232 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:42.442668 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-27e06d8e-c041-4de7-b7a8-ed28013e9232 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:42.449725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-27e06d8e-c041-4de7-b7a8-ed28013e9232 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:42.449725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-27e06d8e-c041-4de7-b7a8-ed28013e9232 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:42.450185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-27e06d8e-c041-4de7-b7a8-ed28013e9232 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:42.451107 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-27e06d8e-c041-4de7-b7a8-ed28013e9232 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:42.451723 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-27e06d8e-c041-4de7-b7a8-ed28013e9232 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:42.452150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-27e06d8e-c041-4de7-b7a8-ed28013e9232 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:42.608696 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-27e06d8e-c041-4de7-b7a8-ed28013e9232 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:42.617738 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-27e06d8e-c041-4de7-b7a8-ed28013e9232 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1501 microversion: 2.1 time: 0.179362 Aug 10 17:17:42.618323 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 251/513] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:42 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1501 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:42.673544 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-c1f5b213-58a5-46d0-8e8c-22708620cebc req-084bba67-7083-4a1e-aff3-afebb0615f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd70709-57e7-4c56-8fc9-3b7a4004f4f5", "name": "network-vif-plugged", "status": "completed", "tag": "9fbbe438-9def-4137-b2cc-411f0ed52ac0"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:42.684307 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c1f5b213-58a5-46d0-8e8c-22708620cebc req-084bba67-7083-4a1e-aff3-afebb0615f43 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:42.684784 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c1f5b213-58a5-46d0-8e8c-22708620cebc req-084bba67-7083-4a1e-aff3-afebb0615f43 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:42.685214 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c1f5b213-58a5-46d0-8e8c-22708620cebc req-084bba67-7083-4a1e-aff3-afebb0615f43 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:42.697917 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-c1f5b213-58a5-46d0-8e8c-22708620cebc req-084bba67-7083-4a1e-aff3-afebb0615f43 service nova] Creating event network-vif-plugged:9fbbe438-9def-4137-b2cc-411f0ed52ac0 for instance 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 on hv-cinder-85272 Aug 10 17:17:42.702900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-c1f5b213-58a5-46d0-8e8c-22708620cebc req-084bba67-7083-4a1e-aff3-afebb0615f43 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033366 Aug 10 17:17:42.703512 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 263/514] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:17:42.843892 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4becae39-86b9-45d4-966c-9873ca3e2290 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:42.844519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4becae39-86b9-45d4-966c-9873ca3e2290 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:42.852132 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4becae39-86b9-45d4-966c-9873ca3e2290 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:42.852635 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4becae39-86b9-45d4-966c-9873ca3e2290 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:42.853073 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4becae39-86b9-45d4-966c-9873ca3e2290 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:42.853898 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4becae39-86b9-45d4-966c-9873ca3e2290 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:42.854369 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4becae39-86b9-45d4-966c-9873ca3e2290 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:42.854815 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4becae39-86b9-45d4-966c-9873ca3e2290 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:42.920142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d00547eb-afce-4cff-9a25-e3370addfdbd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:42.920843 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d00547eb-afce-4cff-9a25-e3370addfdbd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:42.928686 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d00547eb-afce-4cff-9a25-e3370addfdbd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:42.928686 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d00547eb-afce-4cff-9a25-e3370addfdbd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:42.929116 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d00547eb-afce-4cff-9a25-e3370addfdbd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:42.929893 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d00547eb-afce-4cff-9a25-e3370addfdbd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:42.930463 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d00547eb-afce-4cff-9a25-e3370addfdbd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:42.931023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d00547eb-afce-4cff-9a25-e3370addfdbd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:43.054049 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4becae39-86b9-45d4-966c-9873ca3e2290 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:43.061710 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4becae39-86b9-45d4-966c-9873ca3e2290 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1266 microversion: 2.1 time: 0.221693 Aug 10 17:17:43.062288 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 252/515] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:42 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:43.101136 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d00547eb-afce-4cff-9a25-e3370addfdbd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:43.111291 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d00547eb-afce-4cff-9a25-e3370addfdbd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:43.114237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d00547eb-afce-4cff-9a25-e3370addfdbd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:43.116979 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d00547eb-afce-4cff-9a25-e3370addfdbd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1719 microversion: 2.20 time: 0.200986 Aug 10 17:17:43.117973 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 264/516] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:42 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1719 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:43.638736 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5ff150f8-0513-4992-b744-a49468ba56ec tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:43.639351 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5ff150f8-0513-4992-b744-a49468ba56ec tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:43.641292 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:43.645921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ff150f8-0513-4992-b744-a49468ba56ec tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:43.646448 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ff150f8-0513-4992-b744-a49468ba56ec tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:43.647107 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ff150f8-0513-4992-b744-a49468ba56ec tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:43.647807 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ff150f8-0513-4992-b744-a49468ba56ec tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:43.648263 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ff150f8-0513-4992-b744-a49468ba56ec tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:43.648687 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ff150f8-0513-4992-b744-a49468ba56ec tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:43.784840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5ff150f8-0513-4992-b744-a49468ba56ec tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:43.793476 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5ff150f8-0513-4992-b744-a49468ba56ec tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1501 microversion: 2.1 time: 0.158831 Aug 10 17:17:43.794337 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 253/517] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:43 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:44.087790 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f78f95c4-81fc-450e-b899-c1c2e2a72e54 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:44.088511 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f78f95c4-81fc-450e-b899-c1c2e2a72e54 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:44.095444 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f78f95c4-81fc-450e-b899-c1c2e2a72e54 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:44.095874 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f78f95c4-81fc-450e-b899-c1c2e2a72e54 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:44.096405 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f78f95c4-81fc-450e-b899-c1c2e2a72e54 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:44.097026 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f78f95c4-81fc-450e-b899-c1c2e2a72e54 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:44.097483 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f78f95c4-81fc-450e-b899-c1c2e2a72e54 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:44.097910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f78f95c4-81fc-450e-b899-c1c2e2a72e54 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:44.141351 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9a7c9661-5aaf-4d50-bf6d-7f805875e6e2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:44.142016 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9a7c9661-5aaf-4d50-bf6d-7f805875e6e2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:44.149051 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9a7c9661-5aaf-4d50-bf6d-7f805875e6e2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:44.149602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9a7c9661-5aaf-4d50-bf6d-7f805875e6e2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:44.150039 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9a7c9661-5aaf-4d50-bf6d-7f805875e6e2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:44.150765 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9a7c9661-5aaf-4d50-bf6d-7f805875e6e2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:44.151219 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9a7c9661-5aaf-4d50-bf6d-7f805875e6e2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:44.151636 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9a7c9661-5aaf-4d50-bf6d-7f805875e6e2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:44.297720 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f78f95c4-81fc-450e-b899-c1c2e2a72e54 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:44.307997 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f78f95c4-81fc-450e-b899-c1c2e2a72e54 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1266 microversion: 2.1 time: 0.224340 Aug 10 17:17:44.308675 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 265/518] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:44 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:44.341271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9a7c9661-5aaf-4d50-bf6d-7f805875e6e2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:44.350996 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9a7c9661-5aaf-4d50-bf6d-7f805875e6e2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:44.352743 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9a7c9661-5aaf-4d50-bf6d-7f805875e6e2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:44.353948 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9a7c9661-5aaf-4d50-bf6d-7f805875e6e2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1719 microversion: 2.20 time: 0.216505 Aug 10 17:17:44.364521 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 254/519] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:44 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:17:44.814973 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9439513f-575c-4fd0-aab0-9112571f0d22 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:44.815707 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9439513f-575c-4fd0-aab0-9112571f0d22 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:44.822614 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9439513f-575c-4fd0-aab0-9112571f0d22 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:44.823203 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9439513f-575c-4fd0-aab0-9112571f0d22 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:44.823862 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9439513f-575c-4fd0-aab0-9112571f0d22 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:44.824697 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9439513f-575c-4fd0-aab0-9112571f0d22 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:44.825359 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9439513f-575c-4fd0-aab0-9112571f0d22 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:44.825953 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9439513f-575c-4fd0-aab0-9112571f0d22 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:44.843283 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:44.982411 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9439513f-575c-4fd0-aab0-9112571f0d22 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:44.989973 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9439513f-575c-4fd0-aab0-9112571f0d22 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1501 microversion: 2.1 time: 0.179636 Aug 10 17:17:44.991663 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 266/520] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:44 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1501 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:17:45.193611 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-df77bc10-73e2-45c9-a190-3055c179d5ae req-53d3f358-55db-42cd-b2b9-1ca02650549a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b896ebbd-8a0c-4729-98e4-e27e38e70856", "name": "network-vif-deleted", "tag": "8231cc59-a495-4ec2-b108-a116409f6427"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:45.203801 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-df77bc10-73e2-45c9-a190-3055c179d5ae req-53d3f358-55db-42cd-b2b9-1ca02650549a service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:45.204306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-df77bc10-73e2-45c9-a190-3055c179d5ae req-53d3f358-55db-42cd-b2b9-1ca02650549a service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:45.204839 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-df77bc10-73e2-45c9-a190-3055c179d5ae req-53d3f358-55db-42cd-b2b9-1ca02650549a service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:45.216738 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-df77bc10-73e2-45c9-a190-3055c179d5ae req-53d3f358-55db-42cd-b2b9-1ca02650549a service nova] Creating event network-vif-deleted:8231cc59-a495-4ec2-b108-a116409f6427 for instance b896ebbd-8a0c-4729-98e4-e27e38e70856 on hv-cinder-85272 Aug 10 17:17:45.221542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-df77bc10-73e2-45c9-a190-3055c179d5ae req-53d3f358-55db-42cd-b2b9-1ca02650549a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031826 Aug 10 17:17:45.222135 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 255/521] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:17:45.329151 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-34de8bab-c44a-48d0-a762-f32ea402d8da tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:45.329626 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-34de8bab-c44a-48d0-a762-f32ea402d8da tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:45.337948 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34de8bab-c44a-48d0-a762-f32ea402d8da tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:45.338461 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34de8bab-c44a-48d0-a762-f32ea402d8da tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:45.338901 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34de8bab-c44a-48d0-a762-f32ea402d8da tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:45.339637 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34de8bab-c44a-48d0-a762-f32ea402d8da tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:45.340089 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34de8bab-c44a-48d0-a762-f32ea402d8da tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:45.340508 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34de8bab-c44a-48d0-a762-f32ea402d8da tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:45.378292 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-54f788a8-24f7-47ed-977c-4dd430759943 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:45.379641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-54f788a8-24f7-47ed-977c-4dd430759943 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:45.387326 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-54f788a8-24f7-47ed-977c-4dd430759943 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:45.388026 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-54f788a8-24f7-47ed-977c-4dd430759943 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:45.388670 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-54f788a8-24f7-47ed-977c-4dd430759943 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:45.389945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-54f788a8-24f7-47ed-977c-4dd430759943 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:45.390454 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-54f788a8-24f7-47ed-977c-4dd430759943 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:45.393504 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-54f788a8-24f7-47ed-977c-4dd430759943 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:45.550528 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-34de8bab-c44a-48d0-a762-f32ea402d8da tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:45.560803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-34de8bab-c44a-48d0-a762-f32ea402d8da tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1266 microversion: 2.1 time: 0.235577 Aug 10 17:17:45.561636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 267/522] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:45 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:45.579860 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-54f788a8-24f7-47ed-977c-4dd430759943 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:45.588370 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-54f788a8-24f7-47ed-977c-4dd430759943 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:45.589883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-54f788a8-24f7-47ed-977c-4dd430759943 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:45.591100 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-54f788a8-24f7-47ed-977c-4dd430759943 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1719 microversion: 2.20 time: 0.217669 Aug 10 17:17:45.591633 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 256/523] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:45 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1719 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:17:46.013430 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d7c82e96-6ec1-4f58-ac9c-31993ac57238 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:46.014033 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d7c82e96-6ec1-4f58-ac9c-31993ac57238 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:46.020101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7c82e96-6ec1-4f58-ac9c-31993ac57238 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:46.020590 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7c82e96-6ec1-4f58-ac9c-31993ac57238 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:46.021029 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7c82e96-6ec1-4f58-ac9c-31993ac57238 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:46.022221 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7c82e96-6ec1-4f58-ac9c-31993ac57238 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:46.022738 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7c82e96-6ec1-4f58-ac9c-31993ac57238 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:46.023144 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7c82e96-6ec1-4f58-ac9c-31993ac57238 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:46.095822 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d7c82e96-6ec1-4f58-ac9c-31993ac57238 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:46.103832 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d7c82e96-6ec1-4f58-ac9c-31993ac57238 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1298 microversion: 2.1 time: 0.094594 Aug 10 17:17:46.104493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 268/524] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:46 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:46.583849 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-0883b0b7-d556-4567-8980-9cff53f601aa req-06dc82c3-8743-47a7-9c9f-0aed3fc4bd45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e46673f-6139-4b97-b57a-b65886eb16b1", "name": "network-vif-unplugged", "status": "completed", "tag": "65857e53-de9a-43a1-9362-2d62644ab14a"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:46.586848 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5a18cded-db0a-4d6b-8e0b-053e2342c77f tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:46.588376 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5a18cded-db0a-4d6b-8e0b-053e2342c77f tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:46.594707 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-0883b0b7-d556-4567-8980-9cff53f601aa req-06dc82c3-8743-47a7-9c9f-0aed3fc4bd45 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:46.595201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-0883b0b7-d556-4567-8980-9cff53f601aa req-06dc82c3-8743-47a7-9c9f-0aed3fc4bd45 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:46.595638 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-0883b0b7-d556-4567-8980-9cff53f601aa req-06dc82c3-8743-47a7-9c9f-0aed3fc4bd45 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:46.598110 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a18cded-db0a-4d6b-8e0b-053e2342c77f tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:46.599041 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a18cded-db0a-4d6b-8e0b-053e2342c77f tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:46.599761 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a18cded-db0a-4d6b-8e0b-053e2342c77f tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:46.600612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a18cded-db0a-4d6b-8e0b-053e2342c77f tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:46.601293 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a18cded-db0a-4d6b-8e0b-053e2342c77f tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:46.602254 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a18cded-db0a-4d6b-8e0b-053e2342c77f tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:46.629358 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-0883b0b7-d556-4567-8980-9cff53f601aa req-06dc82c3-8743-47a7-9c9f-0aed3fc4bd45 service nova] Creating event network-vif-unplugged:65857e53-de9a-43a1-9362-2d62644ab14a for instance 1e46673f-6139-4b97-b57a-b65886eb16b1 on hv-cinder-85272 Aug 10 17:17:46.634981 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-0883b0b7-d556-4567-8980-9cff53f601aa req-06dc82c3-8743-47a7-9c9f-0aed3fc4bd45 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054889 Aug 10 17:17:46.635973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 257/525] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:17:46.641421 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9824ea58-14f9-47dc-868b-8c0512b494d7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:46.642153 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9824ea58-14f9-47dc-868b-8c0512b494d7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:46.649360 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9824ea58-14f9-47dc-868b-8c0512b494d7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:46.649850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9824ea58-14f9-47dc-868b-8c0512b494d7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:46.650289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9824ea58-14f9-47dc-868b-8c0512b494d7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:46.651268 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9824ea58-14f9-47dc-868b-8c0512b494d7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:46.651541 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9824ea58-14f9-47dc-868b-8c0512b494d7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:46.651973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9824ea58-14f9-47dc-868b-8c0512b494d7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:46.822280 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5a18cded-db0a-4d6b-8e0b-053e2342c77f tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:46.831720 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5a18cded-db0a-4d6b-8e0b-053e2342c77f tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1266 microversion: 2.1 time: 0.250476 Aug 10 17:17:46.832781 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 269/526] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:46 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:46.860734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9824ea58-14f9-47dc-868b-8c0512b494d7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:46.866795 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9824ea58-14f9-47dc-868b-8c0512b494d7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:46.868318 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9824ea58-14f9-47dc-868b-8c0512b494d7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:46.869588 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9824ea58-14f9-47dc-868b-8c0512b494d7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1719 microversion: 2.20 time: 0.232477 Aug 10 17:17:46.870155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 258/527] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:46 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1719 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:47.125307 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-272c72ab-b58a-4694-bc3f-6ea0f9b9dc06 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:47.125835 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-272c72ab-b58a-4694-bc3f-6ea0f9b9dc06 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:47.132403 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-272c72ab-b58a-4694-bc3f-6ea0f9b9dc06 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:47.132896 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-272c72ab-b58a-4694-bc3f-6ea0f9b9dc06 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:47.133384 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-272c72ab-b58a-4694-bc3f-6ea0f9b9dc06 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:47.134080 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-272c72ab-b58a-4694-bc3f-6ea0f9b9dc06 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:47.134575 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-272c72ab-b58a-4694-bc3f-6ea0f9b9dc06 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:47.135015 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-272c72ab-b58a-4694-bc3f-6ea0f9b9dc06 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:47.206336 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-272c72ab-b58a-4694-bc3f-6ea0f9b9dc06 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:47.214779 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-272c72ab-b58a-4694-bc3f-6ea0f9b9dc06 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1298 microversion: 2.1 time: 0.093355 Aug 10 17:17:47.215359 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 270/528] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:47 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:47.853832 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6c8a6f4a-7e3b-44cf-aed9-dc692b4ddca4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:47.853832 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6c8a6f4a-7e3b-44cf-aed9-dc692b4ddca4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:47.860505 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c8a6f4a-7e3b-44cf-aed9-dc692b4ddca4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:47.860993 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c8a6f4a-7e3b-44cf-aed9-dc692b4ddca4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:47.861428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c8a6f4a-7e3b-44cf-aed9-dc692b4ddca4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:47.862131 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c8a6f4a-7e3b-44cf-aed9-dc692b4ddca4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:47.862621 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c8a6f4a-7e3b-44cf-aed9-dc692b4ddca4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:47.863165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c8a6f4a-7e3b-44cf-aed9-dc692b4ddca4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:47.893075 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6559b9be-3472-42c6-83ba-9be5d6a35511 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:47.894028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6559b9be-3472-42c6-83ba-9be5d6a35511 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:47.901778 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6559b9be-3472-42c6-83ba-9be5d6a35511 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:47.902408 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6559b9be-3472-42c6-83ba-9be5d6a35511 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:47.902915 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6559b9be-3472-42c6-83ba-9be5d6a35511 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:47.903684 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6559b9be-3472-42c6-83ba-9be5d6a35511 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:47.904366 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6559b9be-3472-42c6-83ba-9be5d6a35511 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:47.904910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6559b9be-3472-42c6-83ba-9be5d6a35511 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:48.325578 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6c8a6f4a-7e3b-44cf-aed9-dc692b4ddca4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:48.334336 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6c8a6f4a-7e3b-44cf-aed9-dc692b4ddca4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1453 microversion: 2.1 time: 0.485280 Aug 10 17:17:48.335203 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 259/529] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:47 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1453 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:48.341025 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-29a4c856-e222-4908-a4c1-5c641a14df15 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:48.341809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-29a4c856-e222-4908-a4c1-5c641a14df15 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:48.344023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6559b9be-3472-42c6-83ba-9be5d6a35511 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:48.348966 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a4c856-e222-4908-a4c1-5c641a14df15 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:48.349712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a4c856-e222-4908-a4c1-5c641a14df15 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:48.350338 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a4c856-e222-4908-a4c1-5c641a14df15 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:48.351254 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a4c856-e222-4908-a4c1-5c641a14df15 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:48.352276 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a4c856-e222-4908-a4c1-5c641a14df15 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:48.352885 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a4c856-e222-4908-a4c1-5c641a14df15 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:48.358672 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:48.366999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6559b9be-3472-42c6-83ba-9be5d6a35511 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:48.384519 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6559b9be-3472-42c6-83ba-9be5d6a35511 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:48.386092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6559b9be-3472-42c6-83ba-9be5d6a35511 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1719 microversion: 2.20 time: 0.496963 Aug 10 17:17:48.386698 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 271/530] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:47 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1719 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:17:48.390294 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a4c856-e222-4908-a4c1-5c641a14df15 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:48.391002 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a4c856-e222-4908-a4c1-5c641a14df15 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:48.391603 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a4c856-e222-4908-a4c1-5c641a14df15 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:48.392323 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-29a4c856-e222-4908-a4c1-5c641a14df15 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lazy-loading 'fault' on Instance uuid b896ebbd-8a0c-4729-98e4-e27e38e70856 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:17:48.405811 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3fc3a904-3436-403e-aec3-cece0783ff33 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:48.406470 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3fc3a904-3436-403e-aec3-cece0783ff33 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:48.426691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3fc3a904-3436-403e-aec3-cece0783ff33 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:48.427245 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3fc3a904-3436-403e-aec3-cece0783ff33 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:48.427628 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3fc3a904-3436-403e-aec3-cece0783ff33 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:48.429922 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3fc3a904-3436-403e-aec3-cece0783ff33 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:48.430654 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3fc3a904-3436-403e-aec3-cece0783ff33 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:48.431295 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3fc3a904-3436-403e-aec3-cece0783ff33 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:48.445782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-29a4c856-e222-4908-a4c1-5c641a14df15 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:48.454407 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-29a4c856-e222-4908-a4c1-5c641a14df15 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1303 microversion: 2.1 time: 0.117823 Aug 10 17:17:48.467407 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 260/531] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:48 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1303 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:48.580933 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3fc3a904-3436-403e-aec3-cece0783ff33 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:48.588757 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3fc3a904-3436-403e-aec3-cece0783ff33 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1453 microversion: 2.1 time: 0.188576 Aug 10 17:17:48.589334 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 272/532] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:48 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:49.416610 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cce2a47e-adc4-4319-9e9f-b215e3e5c4fb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:49.417324 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cce2a47e-adc4-4319-9e9f-b215e3e5c4fb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:49.432628 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cce2a47e-adc4-4319-9e9f-b215e3e5c4fb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:49.432628 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cce2a47e-adc4-4319-9e9f-b215e3e5c4fb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:49.432628 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cce2a47e-adc4-4319-9e9f-b215e3e5c4fb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:49.432628 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cce2a47e-adc4-4319-9e9f-b215e3e5c4fb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:49.433739 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cce2a47e-adc4-4319-9e9f-b215e3e5c4fb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:49.433739 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cce2a47e-adc4-4319-9e9f-b215e3e5c4fb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:49.491336 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4a453372-3798-4d0f-a5b2-e62809619ab6 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:49.494055 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4a453372-3798-4d0f-a5b2-e62809619ab6 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:49.507803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a453372-3798-4d0f-a5b2-e62809619ab6 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:49.508833 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a453372-3798-4d0f-a5b2-e62809619ab6 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:49.511541 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a453372-3798-4d0f-a5b2-e62809619ab6 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:49.512516 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a453372-3798-4d0f-a5b2-e62809619ab6 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:49.513143 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a453372-3798-4d0f-a5b2-e62809619ab6 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:49.514540 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a453372-3798-4d0f-a5b2-e62809619ab6 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:49.565283 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a453372-3798-4d0f-a5b2-e62809619ab6 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:49.566060 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a453372-3798-4d0f-a5b2-e62809619ab6 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:49.566527 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a453372-3798-4d0f-a5b2-e62809619ab6 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:49.566983 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-4a453372-3798-4d0f-a5b2-e62809619ab6 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lazy-loading 'fault' on Instance uuid b896ebbd-8a0c-4729-98e4-e27e38e70856 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:17:49.645559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4a453372-3798-4d0f-a5b2-e62809619ab6 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44132cbd18f2470dbe9de6b5125d7db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f827cc75b1c449f6a82d5c23af901fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:49.668455 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4a453372-3798-4d0f-a5b2-e62809619ab6 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 200 len: 1303 microversion: 2.1 time: 0.188418 Aug 10 17:17:49.671841 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 273/533] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:49 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 1303 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:17:49.734789 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cce2a47e-adc4-4319-9e9f-b215e3e5c4fb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:49.750211 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cce2a47e-adc4-4319-9e9f-b215e3e5c4fb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:49.752618 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cce2a47e-adc4-4319-9e9f-b215e3e5c4fb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:49.755290 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cce2a47e-adc4-4319-9e9f-b215e3e5c4fb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1722 microversion: 2.20 time: 0.346918 Aug 10 17:17:49.757400 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 261/534] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:49 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:49.781461 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d2a40336-8560-43f5-b78f-915e18ac1f8a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fd9d3a4-d158-432a-838c-e99e974fb4a0"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:49.784156 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d2a40336-8560-43f5-b78f-915e18ac1f8a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:49.791858 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d2a40336-8560-43f5-b78f-915e18ac1f8a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:49.792361 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d2a40336-8560-43f5-b78f-915e18ac1f8a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:49.792803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d2a40336-8560-43f5-b78f-915e18ac1f8a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:49.793550 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d2a40336-8560-43f5-b78f-915e18ac1f8a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:49.794017 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d2a40336-8560-43f5-b78f-915e18ac1f8a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:49.794483 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d2a40336-8560-43f5-b78f-915e18ac1f8a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:50.696613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8c39d8bc-76f1-4f26-a726-d06ce0a389f2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:50.697230 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8c39d8bc-76f1-4f26-a726-d06ce0a389f2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] [instance: b896ebbd-8a0c-4729-98e4-e27e38e70856] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:50.703918 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8c39d8bc-76f1-4f26-a726-d06ce0a389f2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:50.704403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8c39d8bc-76f1-4f26-a726-d06ce0a389f2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:50.706850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8c39d8bc-76f1-4f26-a726-d06ce0a389f2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:50.706850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8c39d8bc-76f1-4f26-a726-d06ce0a389f2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:50.706850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8c39d8bc-76f1-4f26-a726-d06ce0a389f2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:50.706850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8c39d8bc-76f1-4f26-a726-d06ce0a389f2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:50.720908 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-8c39d8bc-76f1-4f26-a726-d06ce0a389f2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] HTTP exception thrown: Instance b896ebbd-8a0c-4729-98e4-e27e38e70856 could not be found. Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8c39d8bc-76f1-4f26-a726-d06ce0a389f2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Request method failure captured: Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 HTTP/1.1 Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-fkB40Jh40Snr6UDJpADVpR47UYDvjWvEY6Xb146R4aZ2qjxQaCG2tRt-wJQc5aGlo0u60LezKNejFkhs7V2GKaYZ4Sj0xGW4ZumiB1Igtto8Yf4sASY_n6jcBJoe8sGkY1Es93Wf_AbFkqtrCOr5BbxufQFRAKf0HJFQel_4PDq3s Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: f827cc75b1c449f6a82d5c23af901fa0 Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesActionsTest-964342551 Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:17:50.722945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:17:50.724342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f827cc75b1c449f6a82d5c23af901fa0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f827cc75b1c449f6a82d5c23af901fa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f827cc75b1c449f6a82d5c23af901fa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f827cc75b1c449f6a82d5c23af901fa0"}]}] Aug 10 17:17:50.724342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesActionsTest-964342551 Aug 10 17:17:50.724342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: f827cc75b1c449f6a82d5c23af901fa0 Aug 10 17:17:50.724342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesActionsTest-964342551 Aug 10 17:17:50.724342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesActionsTest-964342551-project Aug 10 17:17:50.724342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:17:50.724342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:17:50.724342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 44132cbd18f2470dbe9de6b5125d7db5 Aug 10 17:17:50.724342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesActionsTest-964342551-project Aug 10 17:17:50.724342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:17:50.724342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance b896ebbd-8a0c-4729-98e4-e27e38e70856 could not be found. Aug 10 17:17:50.724342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': 'b896ebbd-8a0c-4729-98e4-e27e38e70856'} Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b896ebbd-8a0c-4729-98e4-e27e38e70856 could not be found. Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:17:50.725145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b896ebbd-8a0c-4729-98e4-e27e38e70856 could not be found. Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b896ebbd-8a0c-4729-98e4-e27e38e70856 could not be found. Aug 10 17:17:50.727063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:17:50.728216 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8c39d8bc-76f1-4f26-a726-d06ce0a389f2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] Returning 404 to user: Instance b896ebbd-8a0c-4729-98e4-e27e38e70856 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:17:50.728216 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8c39d8bc-76f1-4f26-a726-d06ce0a389f2 tempest-VolumesActionsTest-964342551 tempest-VolumesActionsTest-964342551-project] 10.222.0.45 "GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856" status: 404 len: 111 microversion: 2.1 time: 0.032370 Aug 10 17:17:50.728216 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 262/535] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:17:50 2022] GET /compute/v2.1/servers/b896ebbd-8a0c-4729-98e4-e27e38e70856 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:17:50.896931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d2a40336-8560-43f5-b78f-915e18ac1f8a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "POST /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.106824 Aug 10 17:17:50.896931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 274/536] 10.222.0.45 () {62 vars in 1364 bytes} [Wed Aug 10 17:17:49 2022] POST /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/os-volume_attachments => generated 188 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:17:51.038632 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-56d390c6-f13d-4ae2-be73-f9ba7f2306bd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:51.039252 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-56d390c6-f13d-4ae2-be73-f9ba7f2306bd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:51.045357 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56d390c6-f13d-4ae2-be73-f9ba7f2306bd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:51.046098 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56d390c6-f13d-4ae2-be73-f9ba7f2306bd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:51.047162 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56d390c6-f13d-4ae2-be73-f9ba7f2306bd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:51.047954 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56d390c6-f13d-4ae2-be73-f9ba7f2306bd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:51.048424 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56d390c6-f13d-4ae2-be73-f9ba7f2306bd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:51.056243 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56d390c6-f13d-4ae2-be73-f9ba7f2306bd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:51.127586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-404a687f-1534-4df3-8511-8bd345df59bc req-8068cc04-417c-48c9-a116-2f5706a8b1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fd70709-57e7-4c56-8fc9-3b7a4004f4f5", "tag": "9fbbe438-9def-4137-b2cc-411f0ed52ac0"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:17:51.134739 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-56d390c6-f13d-4ae2-be73-f9ba7f2306bd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121231) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 17:17:51.138467 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-404a687f-1534-4df3-8511-8bd345df59bc req-8068cc04-417c-48c9-a116-2f5706a8b1bd service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:51.138956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-404a687f-1534-4df3-8511-8bd345df59bc req-8068cc04-417c-48c9-a116-2f5706a8b1bd service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:51.139385 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-404a687f-1534-4df3-8511-8bd345df59bc req-8068cc04-417c-48c9-a116-2f5706a8b1bd service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:51.153284 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-404a687f-1534-4df3-8511-8bd345df59bc req-8068cc04-417c-48c9-a116-2f5706a8b1bd service nova] Creating event network-changed:9fbbe438-9def-4137-b2cc-411f0ed52ac0 for instance 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 on hv-cinder-85272 Aug 10 17:17:51.163466 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-404a687f-1534-4df3-8511-8bd345df59bc req-8068cc04-417c-48c9-a116-2f5706a8b1bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037628 Aug 10 17:17:51.163466 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 275/537] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:17:51.705420 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-56d390c6-f13d-4ae2-be73-f9ba7f2306bd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "POST /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/action" status: 202 len: 0 microversion: 2.20 time: 0.672046 Aug 10 17:17:51.714049 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 263/538] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 10 17:17:51 2022] POST /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/action => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:17:51.720124 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2e64090b-93ba-4ef3-92a6-d783e394ee6f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:51.720822 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2e64090b-93ba-4ef3-92a6-d783e394ee6f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:51.743014 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e64090b-93ba-4ef3-92a6-d783e394ee6f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:51.743616 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e64090b-93ba-4ef3-92a6-d783e394ee6f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:51.744771 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e64090b-93ba-4ef3-92a6-d783e394ee6f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:51.744920 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e64090b-93ba-4ef3-92a6-d783e394ee6f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:51.745274 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e64090b-93ba-4ef3-92a6-d783e394ee6f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:51.745710 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e64090b-93ba-4ef3-92a6-d783e394ee6f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:51.986765 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2e64090b-93ba-4ef3-92a6-d783e394ee6f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:51.998405 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2e64090b-93ba-4ef3-92a6-d783e394ee6f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:52.000157 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2e64090b-93ba-4ef3-92a6-d783e394ee6f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:52.002065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2e64090b-93ba-4ef3-92a6-d783e394ee6f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1748 microversion: 2.20 time: 0.286904 Aug 10 17:17:52.018292 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 276/539] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:51 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1748 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:17:53.026603 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-859b5205-214f-47ab-97b7-325a25573417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:53.027212 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-859b5205-214f-47ab-97b7-325a25573417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:53.033243 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-859b5205-214f-47ab-97b7-325a25573417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:53.033727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-859b5205-214f-47ab-97b7-325a25573417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:53.034160 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-859b5205-214f-47ab-97b7-325a25573417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:53.034873 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-859b5205-214f-47ab-97b7-325a25573417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:53.035327 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-859b5205-214f-47ab-97b7-325a25573417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:53.035749 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-859b5205-214f-47ab-97b7-325a25573417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:53.179092 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-859b5205-214f-47ab-97b7-325a25573417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:53.187547 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-859b5205-214f-47ab-97b7-325a25573417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:53.189044 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-859b5205-214f-47ab-97b7-325a25573417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:53.190202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-859b5205-214f-47ab-97b7-325a25573417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1748 microversion: 2.20 time: 0.168902 Aug 10 17:17:53.190792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 264/540] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:53 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:54.214099 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-618c89e3-6052-44c7-bf9f-87564dde28b1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:54.214915 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-618c89e3-6052-44c7-bf9f-87564dde28b1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:54.221947 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-618c89e3-6052-44c7-bf9f-87564dde28b1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:54.222489 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-618c89e3-6052-44c7-bf9f-87564dde28b1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:54.222943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-618c89e3-6052-44c7-bf9f-87564dde28b1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:54.223660 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-618c89e3-6052-44c7-bf9f-87564dde28b1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:54.224130 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-618c89e3-6052-44c7-bf9f-87564dde28b1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:54.224563 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-618c89e3-6052-44c7-bf9f-87564dde28b1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:54.364876 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-618c89e3-6052-44c7-bf9f-87564dde28b1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:54.374319 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-618c89e3-6052-44c7-bf9f-87564dde28b1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:54.375840 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-618c89e3-6052-44c7-bf9f-87564dde28b1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:54.376998 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-618c89e3-6052-44c7-bf9f-87564dde28b1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1748 microversion: 2.20 time: 0.167070 Aug 10 17:17:54.377551 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 277/541] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:54 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:55.401283 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-561ce50f-2307-435d-a879-7c9cd1e284b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:55.401901 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-561ce50f-2307-435d-a879-7c9cd1e284b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:55.410548 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-561ce50f-2307-435d-a879-7c9cd1e284b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:55.411032 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-561ce50f-2307-435d-a879-7c9cd1e284b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:55.411464 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-561ce50f-2307-435d-a879-7c9cd1e284b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:55.412709 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-561ce50f-2307-435d-a879-7c9cd1e284b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:55.413163 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-561ce50f-2307-435d-a879-7c9cd1e284b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:55.413585 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-561ce50f-2307-435d-a879-7c9cd1e284b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:55.549926 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-561ce50f-2307-435d-a879-7c9cd1e284b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:55.559281 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-561ce50f-2307-435d-a879-7c9cd1e284b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:55.560801 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-561ce50f-2307-435d-a879-7c9cd1e284b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:55.561975 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-561ce50f-2307-435d-a879-7c9cd1e284b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1748 microversion: 2.20 time: 0.164654 Aug 10 17:17:55.562566 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 265/542] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:55 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:56.587778 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a00e722d-da96-4afd-8d7c-ca6576eaf347 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:56.588405 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a00e722d-da96-4afd-8d7c-ca6576eaf347 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:56.595408 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a00e722d-da96-4afd-8d7c-ca6576eaf347 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:56.595907 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a00e722d-da96-4afd-8d7c-ca6576eaf347 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:56.596344 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a00e722d-da96-4afd-8d7c-ca6576eaf347 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:56.597056 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a00e722d-da96-4afd-8d7c-ca6576eaf347 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:56.597514 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a00e722d-da96-4afd-8d7c-ca6576eaf347 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:56.597948 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a00e722d-da96-4afd-8d7c-ca6576eaf347 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:56.746573 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a00e722d-da96-4afd-8d7c-ca6576eaf347 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:56.757511 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a00e722d-da96-4afd-8d7c-ca6576eaf347 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:56.759272 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a00e722d-da96-4afd-8d7c-ca6576eaf347 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:56.760721 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a00e722d-da96-4afd-8d7c-ca6576eaf347 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1750 microversion: 2.20 time: 0.179300 Aug 10 17:17:56.761258 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 278/543] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:56 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:57.786684 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6cd1012c-95a3-4390-913f-6dc1012f065a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:57.789052 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6cd1012c-95a3-4390-913f-6dc1012f065a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:57.810368 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cd1012c-95a3-4390-913f-6dc1012f065a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:57.811389 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cd1012c-95a3-4390-913f-6dc1012f065a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:57.811614 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cd1012c-95a3-4390-913f-6dc1012f065a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:57.812344 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cd1012c-95a3-4390-913f-6dc1012f065a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:57.812866 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cd1012c-95a3-4390-913f-6dc1012f065a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:57.813430 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cd1012c-95a3-4390-913f-6dc1012f065a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:58.013044 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6cd1012c-95a3-4390-913f-6dc1012f065a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:58.023610 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6cd1012c-95a3-4390-913f-6dc1012f065a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:58.026159 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6cd1012c-95a3-4390-913f-6dc1012f065a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:58.027464 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6cd1012c-95a3-4390-913f-6dc1012f065a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1750 microversion: 2.20 time: 0.246818 Aug 10 17:17:58.028602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 266/544] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:57 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1750 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:17:59.052229 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f7804138-5d00-4db2-a55e-d894a5d62b06 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:17:59.053131 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f7804138-5d00-4db2-a55e-d894a5d62b06 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:17:59.061327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7804138-5d00-4db2-a55e-d894a5d62b06 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:59.062340 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7804138-5d00-4db2-a55e-d894a5d62b06 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:59.063105 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7804138-5d00-4db2-a55e-d894a5d62b06 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:59.065784 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7804138-5d00-4db2-a55e-d894a5d62b06 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:17:59.066382 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7804138-5d00-4db2-a55e-d894a5d62b06 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:17:59.067209 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7804138-5d00-4db2-a55e-d894a5d62b06 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:17:59.252758 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f7804138-5d00-4db2-a55e-d894a5d62b06 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:59.263841 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f7804138-5d00-4db2-a55e-d894a5d62b06 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:59.265600 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f7804138-5d00-4db2-a55e-d894a5d62b06 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:17:59.267104 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f7804138-5d00-4db2-a55e-d894a5d62b06 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.219550 Aug 10 17:17:59.284028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 279/545] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:17:59 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:00.294313 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7b7dafbb-3770-42c1-86d8-3bb728043ff5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:00.295947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7b7dafbb-3770-42c1-86d8-3bb728043ff5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:00.306560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b7dafbb-3770-42c1-86d8-3bb728043ff5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:00.307179 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b7dafbb-3770-42c1-86d8-3bb728043ff5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:00.308095 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b7dafbb-3770-42c1-86d8-3bb728043ff5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:00.308988 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b7dafbb-3770-42c1-86d8-3bb728043ff5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:00.309601 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b7dafbb-3770-42c1-86d8-3bb728043ff5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:00.310912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b7dafbb-3770-42c1-86d8-3bb728043ff5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:00.464262 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7b7dafbb-3770-42c1-86d8-3bb728043ff5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:00.479283 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7b7dafbb-3770-42c1-86d8-3bb728043ff5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:00.481171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7b7dafbb-3770-42c1-86d8-3bb728043ff5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:00.482750 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7b7dafbb-3770-42c1-86d8-3bb728043ff5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.194045 Aug 10 17:18:00.483396 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 267/546] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:00 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:01.507794 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-eaf3f614-1f09-4788-b87b-50871ed0a4f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:01.508747 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-eaf3f614-1f09-4788-b87b-50871ed0a4f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:01.515955 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eaf3f614-1f09-4788-b87b-50871ed0a4f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:01.516478 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eaf3f614-1f09-4788-b87b-50871ed0a4f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:01.516944 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eaf3f614-1f09-4788-b87b-50871ed0a4f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:01.517664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eaf3f614-1f09-4788-b87b-50871ed0a4f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:01.518136 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eaf3f614-1f09-4788-b87b-50871ed0a4f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:01.518613 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eaf3f614-1f09-4788-b87b-50871ed0a4f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:01.696454 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-eaf3f614-1f09-4788-b87b-50871ed0a4f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:01.698963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:18:01.706895 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-eaf3f614-1f09-4788-b87b-50871ed0a4f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:01.713756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-eaf3f614-1f09-4788-b87b-50871ed0a4f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:01.713756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-eaf3f614-1f09-4788-b87b-50871ed0a4f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.207398 Aug 10 17:18:01.713756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 280/547] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:01 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:02.737957 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4de436cc-e920-4272-9314-53405b9f7197 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:02.738823 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4de436cc-e920-4272-9314-53405b9f7197 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:02.748545 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4de436cc-e920-4272-9314-53405b9f7197 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:02.749129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4de436cc-e920-4272-9314-53405b9f7197 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:02.749667 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4de436cc-e920-4272-9314-53405b9f7197 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:02.750613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4de436cc-e920-4272-9314-53405b9f7197 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:02.751126 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4de436cc-e920-4272-9314-53405b9f7197 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:02.751836 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4de436cc-e920-4272-9314-53405b9f7197 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:02.928618 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4de436cc-e920-4272-9314-53405b9f7197 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:02.937645 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4de436cc-e920-4272-9314-53405b9f7197 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:02.939375 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4de436cc-e920-4272-9314-53405b9f7197 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:02.940611 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4de436cc-e920-4272-9314-53405b9f7197 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.207622 Aug 10 17:18:02.940913 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 268/548] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:02 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:03.982642 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d062a166-a8ef-4dc1-991d-8ae6cd921bdd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:03.983399 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d062a166-a8ef-4dc1-991d-8ae6cd921bdd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:03.991913 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d062a166-a8ef-4dc1-991d-8ae6cd921bdd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:03.996023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d062a166-a8ef-4dc1-991d-8ae6cd921bdd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:03.996023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d062a166-a8ef-4dc1-991d-8ae6cd921bdd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:03.996023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d062a166-a8ef-4dc1-991d-8ae6cd921bdd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:03.996023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d062a166-a8ef-4dc1-991d-8ae6cd921bdd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:03.996400 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d062a166-a8ef-4dc1-991d-8ae6cd921bdd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:04.179121 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d062a166-a8ef-4dc1-991d-8ae6cd921bdd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:04.194840 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d062a166-a8ef-4dc1-991d-8ae6cd921bdd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:04.197354 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d062a166-a8ef-4dc1-991d-8ae6cd921bdd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:04.198626 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d062a166-a8ef-4dc1-991d-8ae6cd921bdd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.222323 Aug 10 17:18:04.210751 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 281/549] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:03 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:05.224281 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9814e8a6-baa8-4f1c-9379-204d2f75ba49 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:05.225807 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9814e8a6-baa8-4f1c-9379-204d2f75ba49 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:05.237489 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9814e8a6-baa8-4f1c-9379-204d2f75ba49 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:05.238306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9814e8a6-baa8-4f1c-9379-204d2f75ba49 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:05.239073 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9814e8a6-baa8-4f1c-9379-204d2f75ba49 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:05.240039 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9814e8a6-baa8-4f1c-9379-204d2f75ba49 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:05.240766 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9814e8a6-baa8-4f1c-9379-204d2f75ba49 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:05.241240 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9814e8a6-baa8-4f1c-9379-204d2f75ba49 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:05.413246 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9814e8a6-baa8-4f1c-9379-204d2f75ba49 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:05.423057 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9814e8a6-baa8-4f1c-9379-204d2f75ba49 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:05.424971 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9814e8a6-baa8-4f1c-9379-204d2f75ba49 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:05.426219 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9814e8a6-baa8-4f1c-9379-204d2f75ba49 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.205842 Aug 10 17:18:05.426830 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 269/550] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:05 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:06.451061 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-310b7669-c1ad-4c44-aa59-e455be89ee1f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:06.452321 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-310b7669-c1ad-4c44-aa59-e455be89ee1f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:06.455041 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:18:06.460435 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-310b7669-c1ad-4c44-aa59-e455be89ee1f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:06.460890 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-310b7669-c1ad-4c44-aa59-e455be89ee1f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:06.461506 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-310b7669-c1ad-4c44-aa59-e455be89ee1f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:06.462210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-310b7669-c1ad-4c44-aa59-e455be89ee1f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:06.462855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-310b7669-c1ad-4c44-aa59-e455be89ee1f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:06.463478 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-310b7669-c1ad-4c44-aa59-e455be89ee1f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:06.631753 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-310b7669-c1ad-4c44-aa59-e455be89ee1f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:06.641411 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-310b7669-c1ad-4c44-aa59-e455be89ee1f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:06.643015 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-310b7669-c1ad-4c44-aa59-e455be89ee1f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:06.644223 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-310b7669-c1ad-4c44-aa59-e455be89ee1f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.197362 Aug 10 17:18:06.644829 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 282/551] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:06 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:18:07.670273 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c66e8aa5-1980-415d-a840-375da674d1dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:07.671152 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c66e8aa5-1980-415d-a840-375da674d1dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:07.684400 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c66e8aa5-1980-415d-a840-375da674d1dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:07.685787 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c66e8aa5-1980-415d-a840-375da674d1dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:07.685787 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c66e8aa5-1980-415d-a840-375da674d1dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:07.686617 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c66e8aa5-1980-415d-a840-375da674d1dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:07.687120 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c66e8aa5-1980-415d-a840-375da674d1dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:07.687617 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c66e8aa5-1980-415d-a840-375da674d1dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:07.879657 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c66e8aa5-1980-415d-a840-375da674d1dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:07.891727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c66e8aa5-1980-415d-a840-375da674d1dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:07.893419 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c66e8aa5-1980-415d-a840-375da674d1dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:07.894711 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c66e8aa5-1980-415d-a840-375da674d1dc tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.229400 Aug 10 17:18:07.900089 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 270/552] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:07 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:08.921525 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5d148b0f-978b-4c84-9be6-a1dffc37f9a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:08.922209 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5d148b0f-978b-4c84-9be6-a1dffc37f9a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:08.929103 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d148b0f-978b-4c84-9be6-a1dffc37f9a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:08.931036 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d148b0f-978b-4c84-9be6-a1dffc37f9a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:08.931036 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d148b0f-978b-4c84-9be6-a1dffc37f9a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:08.931036 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d148b0f-978b-4c84-9be6-a1dffc37f9a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:08.931309 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d148b0f-978b-4c84-9be6-a1dffc37f9a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:08.931623 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d148b0f-978b-4c84-9be6-a1dffc37f9a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:09.104084 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5d148b0f-978b-4c84-9be6-a1dffc37f9a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:09.119224 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5d148b0f-978b-4c84-9be6-a1dffc37f9a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:09.120835 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5d148b0f-978b-4c84-9be6-a1dffc37f9a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:09.122305 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5d148b0f-978b-4c84-9be6-a1dffc37f9a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.204808 Aug 10 17:18:09.123166 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 283/553] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:08 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:10.152581 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-77326874-960c-48c1-87a7-ba7704760d3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:10.153316 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-77326874-960c-48c1-87a7-ba7704760d3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:10.160630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77326874-960c-48c1-87a7-ba7704760d3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:10.161212 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77326874-960c-48c1-87a7-ba7704760d3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:10.161659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77326874-960c-48c1-87a7-ba7704760d3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:10.162545 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77326874-960c-48c1-87a7-ba7704760d3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:10.163010 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77326874-960c-48c1-87a7-ba7704760d3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:10.163582 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77326874-960c-48c1-87a7-ba7704760d3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:10.332830 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-77326874-960c-48c1-87a7-ba7704760d3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:10.343180 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-77326874-960c-48c1-87a7-ba7704760d3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:10.347676 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-77326874-960c-48c1-87a7-ba7704760d3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:10.349270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-77326874-960c-48c1-87a7-ba7704760d3b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.200916 Aug 10 17:18:10.366454 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 271/554] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:10 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:11.375056 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-83f62447-b716-4923-81e7-4f76cd5f13a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:11.375675 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-83f62447-b716-4923-81e7-4f76cd5f13a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:11.382758 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83f62447-b716-4923-81e7-4f76cd5f13a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:11.383260 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83f62447-b716-4923-81e7-4f76cd5f13a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:11.383905 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83f62447-b716-4923-81e7-4f76cd5f13a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:11.384633 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83f62447-b716-4923-81e7-4f76cd5f13a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:11.385353 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83f62447-b716-4923-81e7-4f76cd5f13a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:11.385790 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83f62447-b716-4923-81e7-4f76cd5f13a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:11.593366 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-83f62447-b716-4923-81e7-4f76cd5f13a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:11.605387 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-83f62447-b716-4923-81e7-4f76cd5f13a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:11.607265 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-83f62447-b716-4923-81e7-4f76cd5f13a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:11.608588 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-83f62447-b716-4923-81e7-4f76cd5f13a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.237646 Aug 10 17:18:11.633137 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 284/555] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:11 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:12.635656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-272010ea-5b7f-4de9-b6c5-9b8f069f5fa9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:12.637868 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-272010ea-5b7f-4de9-b6c5-9b8f069f5fa9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:12.646990 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-272010ea-5b7f-4de9-b6c5-9b8f069f5fa9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:12.648451 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-272010ea-5b7f-4de9-b6c5-9b8f069f5fa9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:12.649285 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-272010ea-5b7f-4de9-b6c5-9b8f069f5fa9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:12.650809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-272010ea-5b7f-4de9-b6c5-9b8f069f5fa9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:12.651660 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-272010ea-5b7f-4de9-b6c5-9b8f069f5fa9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:12.652876 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-272010ea-5b7f-4de9-b6c5-9b8f069f5fa9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:12.926876 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-272010ea-5b7f-4de9-b6c5-9b8f069f5fa9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:12.941069 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-272010ea-5b7f-4de9-b6c5-9b8f069f5fa9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:12.944414 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-272010ea-5b7f-4de9-b6c5-9b8f069f5fa9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:12.946566 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-272010ea-5b7f-4de9-b6c5-9b8f069f5fa9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.316201 Aug 10 17:18:12.947600 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 272/556] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:12 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:13.999365 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-86f9559e-b0f8-47fa-8333-ae4b54a5cac5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:14.000772 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-86f9559e-b0f8-47fa-8333-ae4b54a5cac5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:14.010532 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86f9559e-b0f8-47fa-8333-ae4b54a5cac5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:14.011710 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86f9559e-b0f8-47fa-8333-ae4b54a5cac5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:14.012479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86f9559e-b0f8-47fa-8333-ae4b54a5cac5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:14.014325 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86f9559e-b0f8-47fa-8333-ae4b54a5cac5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:14.016502 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86f9559e-b0f8-47fa-8333-ae4b54a5cac5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:14.017679 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86f9559e-b0f8-47fa-8333-ae4b54a5cac5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:14.358795 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-86f9559e-b0f8-47fa-8333-ae4b54a5cac5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:14.377025 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-86f9559e-b0f8-47fa-8333-ae4b54a5cac5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:14.379732 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-86f9559e-b0f8-47fa-8333-ae4b54a5cac5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:14.386911 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-86f9559e-b0f8-47fa-8333-ae4b54a5cac5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.406523 Aug 10 17:18:14.387827 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 285/557] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:13 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:15.417930 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1d2d801b-3370-48dd-a94a-d97d10bfb664 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:15.418819 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1d2d801b-3370-48dd-a94a-d97d10bfb664 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:15.432628 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:18:15.434874 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1d2d801b-3370-48dd-a94a-d97d10bfb664 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:15.435390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1d2d801b-3370-48dd-a94a-d97d10bfb664 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:15.435849 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1d2d801b-3370-48dd-a94a-d97d10bfb664 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:15.436596 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1d2d801b-3370-48dd-a94a-d97d10bfb664 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:15.437063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1d2d801b-3370-48dd-a94a-d97d10bfb664 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:15.437492 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1d2d801b-3370-48dd-a94a-d97d10bfb664 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:15.821802 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1d2d801b-3370-48dd-a94a-d97d10bfb664 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:15.842733 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1d2d801b-3370-48dd-a94a-d97d10bfb664 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:15.844492 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1d2d801b-3370-48dd-a94a-d97d10bfb664 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:15.846107 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1d2d801b-3370-48dd-a94a-d97d10bfb664 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.431954 Aug 10 17:18:15.846798 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 273/558] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:15 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:18:16.761448 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7f824236-0c46-4357-81e9-349a4f5d3969 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:16.762917 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7f824236-0c46-4357-81e9-349a4f5d3969 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:16.784024 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f824236-0c46-4357-81e9-349a4f5d3969 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:16.785288 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f824236-0c46-4357-81e9-349a4f5d3969 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:16.786403 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f824236-0c46-4357-81e9-349a4f5d3969 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:16.788565 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f824236-0c46-4357-81e9-349a4f5d3969 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:16.789610 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f824236-0c46-4357-81e9-349a4f5d3969 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:16.790673 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f824236-0c46-4357-81e9-349a4f5d3969 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:16.851355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7f824236-0c46-4357-81e9-349a4f5d3969 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df/ips" status: 200 len: 149 microversion: 2.1 time: 0.078965 Aug 10 17:18:16.852949 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 286/559] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 17:18:16 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df/ips => generated 149 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:18:16.864853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c15cee56-550e-4f24-8f80-c71065172544 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86da328c-8b27-4cc4-8d84-43bc342c43b2"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:18:16.868809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c15cee56-550e-4f24-8f80-c71065172544 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:16.877511 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c15cee56-550e-4f24-8f80-c71065172544 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:16.878297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c15cee56-550e-4f24-8f80-c71065172544 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:16.878975 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c15cee56-550e-4f24-8f80-c71065172544 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:16.880070 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c15cee56-550e-4f24-8f80-c71065172544 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:16.880733 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c15cee56-550e-4f24-8f80-c71065172544 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:16.881492 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c15cee56-550e-4f24-8f80-c71065172544 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:16.890205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7f0c1dac-7328-434d-8aaf-f0c930bdf326 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:16.891020 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7f0c1dac-7328-434d-8aaf-f0c930bdf326 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:16.909250 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f0c1dac-7328-434d-8aaf-f0c930bdf326 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:16.909965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f0c1dac-7328-434d-8aaf-f0c930bdf326 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:16.910567 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f0c1dac-7328-434d-8aaf-f0c930bdf326 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:16.911456 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f0c1dac-7328-434d-8aaf-f0c930bdf326 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:16.917449 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f0c1dac-7328-434d-8aaf-f0c930bdf326 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:16.918499 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f0c1dac-7328-434d-8aaf-f0c930bdf326 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:17.082265 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-c15cee56-550e-4f24-8f80-c71065172544 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] HTTP exception thrown: Invalid volume: volume 86da328c-8b27-4cc4-8d84-43bc342c43b2 is already attached to instances: a57e6be9-21bd-4903-a43c-425a17bf4029 Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c15cee56-550e-4f24-8f80-c71065172544 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Request method failure captured: Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: POST /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df/os-volume_attachments HTTP/1.1 Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 74 Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-d1JeRL-7M2oDNopDjpZUxB7lCyD6gM7mAKQjs1c_tbDXZUJQxtkwNVWBVbSkOO7nl_NecmWamydXOiC8XB5d0eHDfa5nNH50PHdLvbF4dkN-n17ApWL5TP6WLuf0j7atmVYlNbqIzfOOdPkW7Q67otg7JGz72UDMA9zNteHBnnxaI Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:18:17.084606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:18:17.086289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cfac2c11f1b24456a5a9efaa9112e281", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}] Aug 10 17:18:17.086289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:18:17.086289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:18:17.086289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:18:17.086289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:18:17.086289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:18:17.086289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:18:17.086289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 48feb2fc02f04e739c5e1bf7d68baa16 Aug 10 17:18:17.086289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:18:17.086289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Aug 10 17:18:17.086289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {"volumeAttachment": {"volumeId": "86da328c-8b27-4cc4-8d84-43bc342c43b2"}} Aug 10 17:18:17.086289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Invalid volume: volume 86da328c-8b27-4cc4-8d84-43bc342c43b2 is already attached to instances: a57e6be9-21bd-4903-a43c-425a17bf4029 Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'server_id': 'ceaebb89-9428-4490-bb2f-fe34917029df', 'body': {'volumeAttachment': {'volumeId': '86da328c-8b27-4cc4-8d84-43bc342c43b2'}}} Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 86da328c-8b27-4cc4-8d84-43bc342c43b2 is already attached to instances: a57e6be9-21bd-4903-a43c-425a17bf4029 Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:17.087317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 86da328c-8b27-4cc4-8d84-43bc342c43b2 is already attached to instances: a57e6be9-21bd-4903-a43c-425a17bf4029 Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:18:17.088808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:18:17.090271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:18:17.090271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:18:17.090271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:18:17.090271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 86da328c-8b27-4cc4-8d84-43bc342c43b2 is already attached to instances: a57e6be9-21bd-4903-a43c-425a17bf4029 Aug 10 17:18:17.090271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:17.092023 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c15cee56-550e-4f24-8f80-c71065172544 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Returning 400 to user: Invalid volume: volume 86da328c-8b27-4cc4-8d84-43bc342c43b2 is already attached to instances: a57e6be9-21bd-4903-a43c-425a17bf4029 {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:18:17.093119 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c15cee56-550e-4f24-8f80-c71065172544 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "POST /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.232717 Aug 10 17:18:17.105884 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 274/560] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 17:18:16 2022] POST /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df/os-volume_attachments => generated 174 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:18:17.125167 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7981e7ad-3d6e-4bac-8865-bb07112ad6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:17.126275 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7981e7ad-3d6e-4bac-8865-bb07112ad6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:17.139932 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7981e7ad-3d6e-4bac-8865-bb07112ad6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:17.140678 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7981e7ad-3d6e-4bac-8865-bb07112ad6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:17.141268 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7981e7ad-3d6e-4bac-8865-bb07112ad6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:17.142219 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7981e7ad-3d6e-4bac-8865-bb07112ad6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:17.142727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7981e7ad-3d6e-4bac-8865-bb07112ad6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:17.143343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7981e7ad-3d6e-4bac-8865-bb07112ad6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:17.148517 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7f0c1dac-7328-434d-8aaf-f0c930bdf326 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:17.158023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7f0c1dac-7328-434d-8aaf-f0c930bdf326 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:17.159673 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7f0c1dac-7328-434d-8aaf-f0c930bdf326 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:17.160945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7f0c1dac-7328-434d-8aaf-f0c930bdf326 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.274751 Aug 10 17:18:17.162014 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 287/561] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:16 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:18:17.173818 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7981e7ad-3d6e-4bac-8865-bb07112ad6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:18:17.193937 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:18:17.495945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7981e7ad-3d6e-4bac-8865-bb07112ad6e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 204 len: 0 microversion: 2.1 time: 0.374728 Aug 10 17:18:17.497307 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 275/562] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:18:17 2022] DELETE /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:18:17.513611 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4d867669-1ea6-408a-a22d-0c1922f9557c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:17.514290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4d867669-1ea6-408a-a22d-0c1922f9557c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:17.522905 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d867669-1ea6-408a-a22d-0c1922f9557c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:17.525714 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d867669-1ea6-408a-a22d-0c1922f9557c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:17.525714 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d867669-1ea6-408a-a22d-0c1922f9557c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:17.525714 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d867669-1ea6-408a-a22d-0c1922f9557c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:17.525714 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d867669-1ea6-408a-a22d-0c1922f9557c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:17.526131 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d867669-1ea6-408a-a22d-0c1922f9557c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:17.691920 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4d867669-1ea6-408a-a22d-0c1922f9557c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:17.712145 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4d867669-1ea6-408a-a22d-0c1922f9557c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1681 microversion: 2.1 time: 0.207353 Aug 10 17:18:17.713273 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 288/563] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:17 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:18.188898 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8b66b642-ad2f-42ba-98c7-5f8400cd34c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:18.190336 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8b66b642-ad2f-42ba-98c7-5f8400cd34c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:18.199109 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b66b642-ad2f-42ba-98c7-5f8400cd34c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:18.200002 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b66b642-ad2f-42ba-98c7-5f8400cd34c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:18.200817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b66b642-ad2f-42ba-98c7-5f8400cd34c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:18.202133 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b66b642-ad2f-42ba-98c7-5f8400cd34c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:18.203066 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b66b642-ad2f-42ba-98c7-5f8400cd34c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:18.203743 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b66b642-ad2f-42ba-98c7-5f8400cd34c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:18.478497 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8b66b642-ad2f-42ba-98c7-5f8400cd34c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:18.493943 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8b66b642-ad2f-42ba-98c7-5f8400cd34c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:18.496235 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8b66b642-ad2f-42ba-98c7-5f8400cd34c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:18.498296 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8b66b642-ad2f-42ba-98c7-5f8400cd34c5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.314097 Aug 10 17:18:18.513550 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 276/564] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:18 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:18.745247 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-06f08987-c354-475f-a26f-19d0e2f3eff6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:18.746729 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-06f08987-c354-475f-a26f-19d0e2f3eff6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:18.760715 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06f08987-c354-475f-a26f-19d0e2f3eff6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:18.761567 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06f08987-c354-475f-a26f-19d0e2f3eff6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:18.762111 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06f08987-c354-475f-a26f-19d0e2f3eff6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:18.771888 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06f08987-c354-475f-a26f-19d0e2f3eff6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:18.773240 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06f08987-c354-475f-a26f-19d0e2f3eff6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:18.774300 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06f08987-c354-475f-a26f-19d0e2f3eff6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:19.131451 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-06f08987-c354-475f-a26f-19d0e2f3eff6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:19.131451 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-06f08987-c354-475f-a26f-19d0e2f3eff6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1681 microversion: 2.1 time: 0.351840 Aug 10 17:18:19.131451 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 289/565] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:18 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1681 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:19.526512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a4601786-3c10-4672-b39d-3e198f357102 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:19.527258 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a4601786-3c10-4672-b39d-3e198f357102 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:19.534330 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4601786-3c10-4672-b39d-3e198f357102 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:19.535329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4601786-3c10-4672-b39d-3e198f357102 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:19.536027 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4601786-3c10-4672-b39d-3e198f357102 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:19.537891 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4601786-3c10-4672-b39d-3e198f357102 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:19.538593 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4601786-3c10-4672-b39d-3e198f357102 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:19.539220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4601786-3c10-4672-b39d-3e198f357102 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:19.773030 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a4601786-3c10-4672-b39d-3e198f357102 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:19.789895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a4601786-3c10-4672-b39d-3e198f357102 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:19.792159 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a4601786-3c10-4672-b39d-3e198f357102 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:19.793628 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a4601786-3c10-4672-b39d-3e198f357102 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.271316 Aug 10 17:18:19.807028 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 277/566] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:19 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:20.152455 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-013ba8e4-5a64-40c1-b5bc-c9fc92f6cbaa tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:20.154779 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-013ba8e4-5a64-40c1-b5bc-c9fc92f6cbaa tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:20.182672 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-013ba8e4-5a64-40c1-b5bc-c9fc92f6cbaa tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:20.184998 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-013ba8e4-5a64-40c1-b5bc-c9fc92f6cbaa tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:20.186604 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-013ba8e4-5a64-40c1-b5bc-c9fc92f6cbaa tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:20.188279 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-013ba8e4-5a64-40c1-b5bc-c9fc92f6cbaa tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:20.189381 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-013ba8e4-5a64-40c1-b5bc-c9fc92f6cbaa tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:20.190583 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-013ba8e4-5a64-40c1-b5bc-c9fc92f6cbaa tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:20.465629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-013ba8e4-5a64-40c1-b5bc-c9fc92f6cbaa tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:20.474862 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-013ba8e4-5a64-40c1-b5bc-c9fc92f6cbaa tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1681 microversion: 2.1 time: 0.335857 Aug 10 17:18:20.475461 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 290/567] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:20 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1681 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:20.821363 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bd0d3c6a-a3c5-4a20-85f0-9aa1442f2b9b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:20.821938 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-bd0d3c6a-a3c5-4a20-85f0-9aa1442f2b9b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:20.828143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd0d3c6a-a3c5-4a20-85f0-9aa1442f2b9b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:20.828636 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd0d3c6a-a3c5-4a20-85f0-9aa1442f2b9b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:20.829074 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd0d3c6a-a3c5-4a20-85f0-9aa1442f2b9b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:20.829772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd0d3c6a-a3c5-4a20-85f0-9aa1442f2b9b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:20.830335 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd0d3c6a-a3c5-4a20-85f0-9aa1442f2b9b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:20.830781 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd0d3c6a-a3c5-4a20-85f0-9aa1442f2b9b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:21.054583 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bd0d3c6a-a3c5-4a20-85f0-9aa1442f2b9b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:21.065194 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bd0d3c6a-a3c5-4a20-85f0-9aa1442f2b9b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:21.067048 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bd0d3c6a-a3c5-4a20-85f0-9aa1442f2b9b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:21.070385 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bd0d3c6a-a3c5-4a20-85f0-9aa1442f2b9b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.255167 Aug 10 17:18:21.071331 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 278/568] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:20 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:18:21.509130 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-50308842-b980-4fb9-b8e1-f19fd05766ab tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:21.509774 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-50308842-b980-4fb9-b8e1-f19fd05766ab tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:21.516694 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50308842-b980-4fb9-b8e1-f19fd05766ab tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:21.517439 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50308842-b980-4fb9-b8e1-f19fd05766ab tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:21.518040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50308842-b980-4fb9-b8e1-f19fd05766ab tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:21.518976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50308842-b980-4fb9-b8e1-f19fd05766ab tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:21.519599 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50308842-b980-4fb9-b8e1-f19fd05766ab tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:21.520191 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50308842-b980-4fb9-b8e1-f19fd05766ab tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:21.718686 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-50308842-b980-4fb9-b8e1-f19fd05766ab tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:21.728728 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-50308842-b980-4fb9-b8e1-f19fd05766ab tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1681 microversion: 2.1 time: 0.223643 Aug 10 17:18:21.729760 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 291/569] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:21 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:22.095301 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a7004df7-afe8-4982-84bf-bc5080e08715 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:22.096175 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a7004df7-afe8-4982-84bf-bc5080e08715 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:22.103328 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a7004df7-afe8-4982-84bf-bc5080e08715 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:22.103817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a7004df7-afe8-4982-84bf-bc5080e08715 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:22.104265 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a7004df7-afe8-4982-84bf-bc5080e08715 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:22.104994 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a7004df7-afe8-4982-84bf-bc5080e08715 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:22.105454 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a7004df7-afe8-4982-84bf-bc5080e08715 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:22.105872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a7004df7-afe8-4982-84bf-bc5080e08715 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:22.265040 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a7004df7-afe8-4982-84bf-bc5080e08715 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:22.274085 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a7004df7-afe8-4982-84bf-bc5080e08715 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:22.275640 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a7004df7-afe8-4982-84bf-bc5080e08715 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:22.276840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a7004df7-afe8-4982-84bf-bc5080e08715 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.186764 Aug 10 17:18:22.277400 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 279/570] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:22 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:22.753282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6153db80-e9db-4310-bec5-e6f5f31b50a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:22.753910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6153db80-e9db-4310-bec5-e6f5f31b50a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:22.761152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6153db80-e9db-4310-bec5-e6f5f31b50a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:22.761649 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6153db80-e9db-4310-bec5-e6f5f31b50a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:22.762096 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6153db80-e9db-4310-bec5-e6f5f31b50a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:22.762846 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6153db80-e9db-4310-bec5-e6f5f31b50a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:22.763307 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6153db80-e9db-4310-bec5-e6f5f31b50a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:22.763742 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6153db80-e9db-4310-bec5-e6f5f31b50a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:22.912011 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6153db80-e9db-4310-bec5-e6f5f31b50a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:22.920405 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6153db80-e9db-4310-bec5-e6f5f31b50a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1681 microversion: 2.1 time: 0.170894 Aug 10 17:18:22.920985 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 292/571] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:22 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:23.304574 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f427670a-2cf4-4d9d-8af9-10a5db133c44 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:23.305302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f427670a-2cf4-4d9d-8af9-10a5db133c44 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:23.313325 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f427670a-2cf4-4d9d-8af9-10a5db133c44 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:23.313832 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f427670a-2cf4-4d9d-8af9-10a5db133c44 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:23.314486 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f427670a-2cf4-4d9d-8af9-10a5db133c44 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:23.315231 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f427670a-2cf4-4d9d-8af9-10a5db133c44 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:23.315691 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f427670a-2cf4-4d9d-8af9-10a5db133c44 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:23.316142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f427670a-2cf4-4d9d-8af9-10a5db133c44 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:23.478589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f427670a-2cf4-4d9d-8af9-10a5db133c44 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:23.502631 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f427670a-2cf4-4d9d-8af9-10a5db133c44 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:23.507751 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f427670a-2cf4-4d9d-8af9-10a5db133c44 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:23.509792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f427670a-2cf4-4d9d-8af9-10a5db133c44 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.211223 Aug 10 17:18:23.526505 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 280/572] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:23 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:23.941312 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d12b842d-33a8-4e30-bdb5-34cfee2ac307 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:23.941959 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d12b842d-33a8-4e30-bdb5-34cfee2ac307 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:23.948540 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d12b842d-33a8-4e30-bdb5-34cfee2ac307 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:23.949030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d12b842d-33a8-4e30-bdb5-34cfee2ac307 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:23.949468 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d12b842d-33a8-4e30-bdb5-34cfee2ac307 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:23.950168 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d12b842d-33a8-4e30-bdb5-34cfee2ac307 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:23.950653 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d12b842d-33a8-4e30-bdb5-34cfee2ac307 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:23.951078 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d12b842d-33a8-4e30-bdb5-34cfee2ac307 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:24.129888 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d12b842d-33a8-4e30-bdb5-34cfee2ac307 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:24.137848 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d12b842d-33a8-4e30-bdb5-34cfee2ac307 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1681 microversion: 2.1 time: 0.200438 Aug 10 17:18:24.138595 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 293/573] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:23 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:24.535778 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6bf6eda3-fbb5-4664-b594-eacc4d38ce9d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:24.536343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6bf6eda3-fbb5-4664-b594-eacc4d38ce9d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:24.543208 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6bf6eda3-fbb5-4664-b594-eacc4d38ce9d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:24.543744 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6bf6eda3-fbb5-4664-b594-eacc4d38ce9d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:24.544179 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6bf6eda3-fbb5-4664-b594-eacc4d38ce9d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:24.544871 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6bf6eda3-fbb5-4664-b594-eacc4d38ce9d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:24.545321 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6bf6eda3-fbb5-4664-b594-eacc4d38ce9d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:24.545736 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6bf6eda3-fbb5-4664-b594-eacc4d38ce9d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:24.682998 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6bf6eda3-fbb5-4664-b594-eacc4d38ce9d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:24.692484 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6bf6eda3-fbb5-4664-b594-eacc4d38ce9d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:24.694624 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6bf6eda3-fbb5-4664-b594-eacc4d38ce9d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:24.695791 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6bf6eda3-fbb5-4664-b594-eacc4d38ce9d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.165080 Aug 10 17:18:24.696354 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 281/574] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:24 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:25.161173 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e26ceb0a-b298-4334-a856-af9f8d23ff1d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:25.162851 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e26ceb0a-b298-4334-a856-af9f8d23ff1d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:25.169579 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e26ceb0a-b298-4334-a856-af9f8d23ff1d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:25.170074 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e26ceb0a-b298-4334-a856-af9f8d23ff1d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:25.170613 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e26ceb0a-b298-4334-a856-af9f8d23ff1d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:25.171324 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e26ceb0a-b298-4334-a856-af9f8d23ff1d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:25.171777 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e26ceb0a-b298-4334-a856-af9f8d23ff1d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:25.172233 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e26ceb0a-b298-4334-a856-af9f8d23ff1d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:25.313785 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e26ceb0a-b298-4334-a856-af9f8d23ff1d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:25.321779 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e26ceb0a-b298-4334-a856-af9f8d23ff1d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1681 microversion: 2.1 time: 0.164454 Aug 10 17:18:25.322368 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 294/575] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:25 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:25.719450 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-08a9c417-4208-4e6c-89b9-5695b6276a00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:25.720215 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-08a9c417-4208-4e6c-89b9-5695b6276a00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:25.727831 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08a9c417-4208-4e6c-89b9-5695b6276a00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:25.728323 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08a9c417-4208-4e6c-89b9-5695b6276a00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:25.728750 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08a9c417-4208-4e6c-89b9-5695b6276a00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:25.729558 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08a9c417-4208-4e6c-89b9-5695b6276a00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:25.730012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08a9c417-4208-4e6c-89b9-5695b6276a00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:25.730461 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08a9c417-4208-4e6c-89b9-5695b6276a00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:25.866676 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-08a9c417-4208-4e6c-89b9-5695b6276a00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:25.875895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-08a9c417-4208-4e6c-89b9-5695b6276a00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:25.887348 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-08a9c417-4208-4e6c-89b9-5695b6276a00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:25.887348 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-08a9c417-4208-4e6c-89b9-5695b6276a00 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.163195 Aug 10 17:18:25.887348 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 282/576] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:25 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:18:26.345196 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-26acae77-e841-489c-9bed-92736d3bc281 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:26.345843 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-26acae77-e841-489c-9bed-92736d3bc281 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:26.352805 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26acae77-e841-489c-9bed-92736d3bc281 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:26.353301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26acae77-e841-489c-9bed-92736d3bc281 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:26.353737 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26acae77-e841-489c-9bed-92736d3bc281 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:26.354484 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26acae77-e841-489c-9bed-92736d3bc281 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:26.354945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26acae77-e841-489c-9bed-92736d3bc281 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:26.355371 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26acae77-e841-489c-9bed-92736d3bc281 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:26.495507 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-26acae77-e841-489c-9bed-92736d3bc281 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:26.503446 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-26acae77-e841-489c-9bed-92736d3bc281 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1681 microversion: 2.1 time: 0.163056 Aug 10 17:18:26.505253 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 295/577] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:26 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:26.910430 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ff75fad2-2d5d-41b4-89e9-55c55628a836 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:26.911172 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ff75fad2-2d5d-41b4-89e9-55c55628a836 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:26.918960 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff75fad2-2d5d-41b4-89e9-55c55628a836 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:26.919442 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff75fad2-2d5d-41b4-89e9-55c55628a836 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:26.919875 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff75fad2-2d5d-41b4-89e9-55c55628a836 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:26.920562 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff75fad2-2d5d-41b4-89e9-55c55628a836 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:26.921009 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff75fad2-2d5d-41b4-89e9-55c55628a836 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:26.921434 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff75fad2-2d5d-41b4-89e9-55c55628a836 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:27.056400 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ff75fad2-2d5d-41b4-89e9-55c55628a836 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:27.064847 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ff75fad2-2d5d-41b4-89e9-55c55628a836 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:27.066437 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ff75fad2-2d5d-41b4-89e9-55c55628a836 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:27.079459 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ff75fad2-2d5d-41b4-89e9-55c55628a836 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.161208 Aug 10 17:18:27.079459 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 283/578] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:26 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:27.525420 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7a534b2a-df32-4450-94f1-17ac9d1affea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:27.525943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7a534b2a-df32-4450-94f1-17ac9d1affea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:27.532569 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a534b2a-df32-4450-94f1-17ac9d1affea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:27.533095 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a534b2a-df32-4450-94f1-17ac9d1affea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:27.533531 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a534b2a-df32-4450-94f1-17ac9d1affea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:27.534231 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a534b2a-df32-4450-94f1-17ac9d1affea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:27.534892 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a534b2a-df32-4450-94f1-17ac9d1affea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:27.535328 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a534b2a-df32-4450-94f1-17ac9d1affea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:28.024542 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7a534b2a-df32-4450-94f1-17ac9d1affea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:28.037482 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7a534b2a-df32-4450-94f1-17ac9d1affea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1681 microversion: 2.1 time: 0.512232 Aug 10 17:18:28.037656 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 296/579] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:27 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1681 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:28.094866 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3750e577-2574-42de-8743-085b41e3d2f8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:28.095972 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3750e577-2574-42de-8743-085b41e3d2f8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:28.103425 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3750e577-2574-42de-8743-085b41e3d2f8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:28.104167 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3750e577-2574-42de-8743-085b41e3d2f8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:28.104798 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3750e577-2574-42de-8743-085b41e3d2f8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:28.105509 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3750e577-2574-42de-8743-085b41e3d2f8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:28.105966 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3750e577-2574-42de-8743-085b41e3d2f8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:28.106525 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3750e577-2574-42de-8743-085b41e3d2f8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:28.289022 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3750e577-2574-42de-8743-085b41e3d2f8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:28.300828 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3750e577-2574-42de-8743-085b41e3d2f8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:28.303343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3750e577-2574-42de-8743-085b41e3d2f8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:28.304559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3750e577-2574-42de-8743-085b41e3d2f8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.214040 Aug 10 17:18:28.307498 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 284/580] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:28 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:28.625372 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1cd33ae2-875e-40ea-9a64-bb031d50a67d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:28.625876 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1cd33ae2-875e-40ea-9a64-bb031d50a67d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:28.632416 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cd33ae2-875e-40ea-9a64-bb031d50a67d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:28.632993 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cd33ae2-875e-40ea-9a64-bb031d50a67d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:28.633492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cd33ae2-875e-40ea-9a64-bb031d50a67d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:28.634343 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cd33ae2-875e-40ea-9a64-bb031d50a67d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:28.635162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cd33ae2-875e-40ea-9a64-bb031d50a67d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:28.636478 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cd33ae2-875e-40ea-9a64-bb031d50a67d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:28.793912 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:18:28.805762 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-1cd33ae2-875e-40ea-9a64-bb031d50a67d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lazy-loading 'services' on Instance uuid ffd37426-ce25-4561-91df-9058dc474b7d {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:18:28.931049 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-793608a4-0c20-4875-a558-4e543f4cb152 req-aab80475-e5f7-4e35-80b5-8f95dbde7d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceaebb89-9428-4490-bb2f-fe34917029df", "name": "network-vif-deleted", "tag": "91640510-d3e4-4993-9b5c-ceecbca49523"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:18:28.941151 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-793608a4-0c20-4875-a558-4e543f4cb152 req-aab80475-e5f7-4e35-80b5-8f95dbde7d99 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:28.941626 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-793608a4-0c20-4875-a558-4e543f4cb152 req-aab80475-e5f7-4e35-80b5-8f95dbde7d99 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:28.942249 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-793608a4-0c20-4875-a558-4e543f4cb152 req-aab80475-e5f7-4e35-80b5-8f95dbde7d99 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:28.956526 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-793608a4-0c20-4875-a558-4e543f4cb152 req-aab80475-e5f7-4e35-80b5-8f95dbde7d99 service nova] Creating event network-vif-deleted:91640510-d3e4-4993-9b5c-ceecbca49523 for instance ceaebb89-9428-4490-bb2f-fe34917029df on hv-cinder-85272 Aug 10 17:18:28.963912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-793608a4-0c20-4875-a558-4e543f4cb152 req-aab80475-e5f7-4e35-80b5-8f95dbde7d99 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036974 Aug 10 17:18:28.965240 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 285/581] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:18:29.056520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bf8cb55a-d148-48e2-9e31-7091669bb743 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:29.057369 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-bf8cb55a-d148-48e2-9e31-7091669bb743 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:29.064192 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf8cb55a-d148-48e2-9e31-7091669bb743 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:29.064795 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf8cb55a-d148-48e2-9e31-7091669bb743 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:29.065474 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf8cb55a-d148-48e2-9e31-7091669bb743 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:29.066401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf8cb55a-d148-48e2-9e31-7091669bb743 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:29.066870 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf8cb55a-d148-48e2-9e31-7091669bb743 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:29.067303 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf8cb55a-d148-48e2-9e31-7091669bb743 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:29.123962 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1cd33ae2-875e-40ea-9a64-bb031d50a67d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/os-volume_attachments/c172be9d-c219-4275-bc2b-bc5d6168dda6" status: 202 len: 0 microversion: 2.1 time: 0.502429 Aug 10 17:18:29.132230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 297/582] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 17:18:28 2022] DELETE /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/os-volume_attachments/c172be9d-c219-4275-bc2b-bc5d6168dda6 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:18:29.185392 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bf8cb55a-d148-48e2-9e31-7091669bb743 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:29.198277 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bf8cb55a-d148-48e2-9e31-7091669bb743 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1613 microversion: 2.1 time: 0.146179 Aug 10 17:18:29.199214 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 286/583] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:29 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1613 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:29.331865 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-32ef95a0-f30c-4339-aa9a-a03fd75725ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:29.332670 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-32ef95a0-f30c-4339-aa9a-a03fd75725ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:29.339660 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32ef95a0-f30c-4339-aa9a-a03fd75725ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:29.340150 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32ef95a0-f30c-4339-aa9a-a03fd75725ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:29.340961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32ef95a0-f30c-4339-aa9a-a03fd75725ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:29.341838 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32ef95a0-f30c-4339-aa9a-a03fd75725ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:29.342593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32ef95a0-f30c-4339-aa9a-a03fd75725ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:29.343027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32ef95a0-f30c-4339-aa9a-a03fd75725ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:29.510818 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-32ef95a0-f30c-4339-aa9a-a03fd75725ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:29.524005 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-32ef95a0-f30c-4339-aa9a-a03fd75725ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:29.526249 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-32ef95a0-f30c-4339-aa9a-a03fd75725ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:29.527527 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-32ef95a0-f30c-4339-aa9a-a03fd75725ca tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.201391 Aug 10 17:18:29.528283 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 298/584] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:29 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:30.219709 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f80ab3db-1318-416c-a7df-f70f416ce6db tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:30.220327 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f80ab3db-1318-416c-a7df-f70f416ce6db tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:30.236134 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f80ab3db-1318-416c-a7df-f70f416ce6db tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:30.236134 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f80ab3db-1318-416c-a7df-f70f416ce6db tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:30.236489 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f80ab3db-1318-416c-a7df-f70f416ce6db tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:30.237259 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f80ab3db-1318-416c-a7df-f70f416ce6db tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:30.237722 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f80ab3db-1318-416c-a7df-f70f416ce6db tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:30.238149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f80ab3db-1318-416c-a7df-f70f416ce6db tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:30.286084 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f80ab3db-1318-416c-a7df-f70f416ce6db tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:30.287273 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f80ab3db-1318-416c-a7df-f70f416ce6db tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:30.288447 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f80ab3db-1318-416c-a7df-f70f416ce6db tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:30.288993 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-f80ab3db-1318-416c-a7df-f70f416ce6db tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lazy-loading 'fault' on Instance uuid ceaebb89-9428-4490-bb2f-fe34917029df {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:18:30.359796 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f80ab3db-1318-416c-a7df-f70f416ce6db tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:30.371032 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f80ab3db-1318-416c-a7df-f70f416ce6db tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 200 len: 1331 microversion: 2.1 time: 0.154806 Aug 10 17:18:30.373851 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 287/585] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:30 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 1331 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:30.556023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5d770185-a483-46be-b7c9-b6dbc5ede6f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:30.556697 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5d770185-a483-46be-b7c9-b6dbc5ede6f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:30.563706 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d770185-a483-46be-b7c9-b6dbc5ede6f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:30.564404 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d770185-a483-46be-b7c9-b6dbc5ede6f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:30.565011 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d770185-a483-46be-b7c9-b6dbc5ede6f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:30.565731 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d770185-a483-46be-b7c9-b6dbc5ede6f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:30.566195 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d770185-a483-46be-b7c9-b6dbc5ede6f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:30.566655 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d770185-a483-46be-b7c9-b6dbc5ede6f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:30.785209 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5d770185-a483-46be-b7c9-b6dbc5ede6f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:30.794428 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5d770185-a483-46be-b7c9-b6dbc5ede6f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:30.795992 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5d770185-a483-46be-b7c9-b6dbc5ede6f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:30.797364 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5d770185-a483-46be-b7c9-b6dbc5ede6f1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.248738 Aug 10 17:18:30.797924 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 299/586] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:30 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:31.399129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e26aade0-b89d-46d2-88d5-79baa1371e95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:31.399748 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e26aade0-b89d-46d2-88d5-79baa1371e95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:31.404950 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cd9b8763-5f70-4617-a71c-2923ecdfcf60 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:18:31.408682 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e26aade0-b89d-46d2-88d5-79baa1371e95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:31.409175 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e26aade0-b89d-46d2-88d5-79baa1371e95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:31.409612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e26aade0-b89d-46d2-88d5-79baa1371e95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:31.410304 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e26aade0-b89d-46d2-88d5-79baa1371e95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:31.410917 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e26aade0-b89d-46d2-88d5-79baa1371e95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:31.412904 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e26aade0-b89d-46d2-88d5-79baa1371e95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:31.413718 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd9b8763-5f70-4617-a71c-2923ecdfcf60 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:31.414231 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd9b8763-5f70-4617-a71c-2923ecdfcf60 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:31.414847 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd9b8763-5f70-4617-a71c-2923ecdfcf60 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:31.428113 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-e26aade0-b89d-46d2-88d5-79baa1371e95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] HTTP exception thrown: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e26aade0-b89d-46d2-88d5-79baa1371e95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Request method failure captured: Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df HTTP/1.1 Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-d1JeRL-7M2oDNopDjpZUxB7lCyD6gM7mAKQjs1c_tbDXZUJQxtkwNVWBVbSkOO7nl_NecmWamydXOiC8XB5d0eHDfa5nNH50PHdLvbF4dkN-n17ApWL5TP6WLuf0j7atmVYlNbqIzfOOdPkW7Q67otg7JGz72UDMA9zNteHBnnxaI Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:18:31.429797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:18:31.431408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cfac2c11f1b24456a5a9efaa9112e281", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}] Aug 10 17:18:31.431408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:18:31.431408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:18:31.431408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:18:31.431408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:18:31.431408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:18:31.431408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:18:31.431408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 48feb2fc02f04e739c5e1bf7d68baa16 Aug 10 17:18:31.431408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:18:31.431408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:18:31.431408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:18:31.431408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': 'ceaebb89-9428-4490-bb2f-fe34917029df'} Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:18:31.432143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:18:31.433531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:31.434666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e26aade0-b89d-46d2-88d5-79baa1371e95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Returning 404 to user: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:18:31.434666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e26aade0-b89d-46d2-88d5-79baa1371e95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 404 len: 111 microversion: 2.1 time: 0.036798 Aug 10 17:18:31.434666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 288/587] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:31 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:18:31.440099 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-74e5d92b-0fb6-4d7d-9b95-6d75fc5f69ce tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '.version_select at 0x7f7eba017af0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:31.450037 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cd9b8763-5f70-4617-a71c-2923ecdfcf60 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Going to try to stop instance {{(pid=121232) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 17:18:31.617857 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-74e5d92b-0fb6-4d7d-9b95-6d75fc5f69ce tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100369984" status: 202 len: 0 microversion: 2.1 time: 0.176650 Aug 10 17:18:31.617857 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 289/588] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 10 17:18:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100369984 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:18:31.719373 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cd9b8763-5f70-4617-a71c-2923ecdfcf60 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "POST /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/action" status: 202 len: 0 microversion: 2.1 time: 0.319300 Aug 10 17:18:31.719994 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 300/589] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:18:31 2022] POST /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:18:31.730868 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8384278f-0c7f-459c-97ac-bf4d9eb1ce85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:31.731721 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8384278f-0c7f-459c-97ac-bf4d9eb1ce85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:31.739183 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8384278f-0c7f-459c-97ac-bf4d9eb1ce85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:31.739809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8384278f-0c7f-459c-97ac-bf4d9eb1ce85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:31.740321 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8384278f-0c7f-459c-97ac-bf4d9eb1ce85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:31.741135 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8384278f-0c7f-459c-97ac-bf4d9eb1ce85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:31.741829 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8384278f-0c7f-459c-97ac-bf4d9eb1ce85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:31.742501 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8384278f-0c7f-459c-97ac-bf4d9eb1ce85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:31.822651 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8a2559ac-0ff4-4862-83ae-6765d24f89f7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:31.823598 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8a2559ac-0ff4-4862-83ae-6765d24f89f7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:31.837445 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a2559ac-0ff4-4862-83ae-6765d24f89f7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:31.837953 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a2559ac-0ff4-4862-83ae-6765d24f89f7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:31.838418 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a2559ac-0ff4-4862-83ae-6765d24f89f7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:31.839137 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a2559ac-0ff4-4862-83ae-6765d24f89f7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:31.839592 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a2559ac-0ff4-4862-83ae-6765d24f89f7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:31.840011 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a2559ac-0ff4-4862-83ae-6765d24f89f7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:32.044643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8384278f-0c7f-459c-97ac-bf4d9eb1ce85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:32.054015 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8384278f-0c7f-459c-97ac-bf4d9eb1ce85 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1677 microversion: 2.1 time: 0.328862 Aug 10 17:18:32.055673 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 290/590] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:31 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1677 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:32.109821 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8a2559ac-0ff4-4862-83ae-6765d24f89f7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:32.119454 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8a2559ac-0ff4-4862-83ae-6765d24f89f7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:32.120966 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8a2559ac-0ff4-4862-83ae-6765d24f89f7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:32.122286 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8a2559ac-0ff4-4862-83ae-6765d24f89f7 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.304760 Aug 10 17:18:32.126736 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 301/591] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:31 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:18:32.808595 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1f6a3d00-964f-4f59-8809-83afd368d796 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:32.818261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1f6a3d00-964f-4f59-8809-83afd368d796 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:32.818261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f6a3d00-964f-4f59-8809-83afd368d796 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:32.818261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f6a3d00-964f-4f59-8809-83afd368d796 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:32.818261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f6a3d00-964f-4f59-8809-83afd368d796 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:32.819298 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f6a3d00-964f-4f59-8809-83afd368d796 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:32.819298 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f6a3d00-964f-4f59-8809-83afd368d796 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:32.819298 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f6a3d00-964f-4f59-8809-83afd368d796 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:32.844316 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9cf03fb2-392b-4272-9d7b-55b591fc7cb8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3210059d-735c-485a-a95d-34138d4f7c6f"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:18:32.852143 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9cf03fb2-392b-4272-9d7b-55b591fc7cb8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:32.862183 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9cf03fb2-392b-4272-9d7b-55b591fc7cb8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:32.862970 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9cf03fb2-392b-4272-9d7b-55b591fc7cb8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:32.865188 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9cf03fb2-392b-4272-9d7b-55b591fc7cb8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:32.866109 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9cf03fb2-392b-4272-9d7b-55b591fc7cb8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:32.866807 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9cf03fb2-392b-4272-9d7b-55b591fc7cb8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:32.867462 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9cf03fb2-392b-4272-9d7b-55b591fc7cb8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:32.977359 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-1f6a3d00-964f-4f59-8809-83afd368d796 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lazy-loading 'services' on Instance uuid a57e6be9-21bd-4903-a43c-425a17bf4029 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:18:33.327418 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1f6a3d00-964f-4f59-8809-83afd368d796 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029/os-volume_attachments/86da328c-8b27-4cc4-8d84-43bc342c43b2" status: 202 len: 0 microversion: 2.1 time: 0.522718 Aug 10 17:18:33.328003 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 291/592] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 17:18:32 2022] DELETE /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029/os-volume_attachments/86da328c-8b27-4cc4-8d84-43bc342c43b2 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:18:33.335612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b2ef2462-aeac-4cd0-8169-5aefbb123417 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:33.336300 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b2ef2462-aeac-4cd0-8169-5aefbb123417 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:33.342409 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2ef2462-aeac-4cd0-8169-5aefbb123417 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:33.342891 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2ef2462-aeac-4cd0-8169-5aefbb123417 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:33.343320 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2ef2462-aeac-4cd0-8169-5aefbb123417 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:33.344002 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2ef2462-aeac-4cd0-8169-5aefbb123417 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:33.344449 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2ef2462-aeac-4cd0-8169-5aefbb123417 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:33.344865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2ef2462-aeac-4cd0-8169-5aefbb123417 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:33.363222 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:18:33.487502 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b2ef2462-aeac-4cd0-8169-5aefbb123417 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:33.497239 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b2ef2462-aeac-4cd0-8169-5aefbb123417 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1677 microversion: 2.1 time: 0.167993 Aug 10 17:18:33.497834 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 292/593] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:33 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:33.507993 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6d276216-f95c-4b45-9a08-21ab79b417f3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:33.508888 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6d276216-f95c-4b45-9a08-21ab79b417f3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:33.517741 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d276216-f95c-4b45-9a08-21ab79b417f3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:33.519072 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d276216-f95c-4b45-9a08-21ab79b417f3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:33.519542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d276216-f95c-4b45-9a08-21ab79b417f3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:33.520376 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d276216-f95c-4b45-9a08-21ab79b417f3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:33.520847 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d276216-f95c-4b45-9a08-21ab79b417f3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:33.521484 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d276216-f95c-4b45-9a08-21ab79b417f3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:33.668408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6d276216-f95c-4b45-9a08-21ab79b417f3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:33.678009 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6d276216-f95c-4b45-9a08-21ab79b417f3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:33.679579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6d276216-f95c-4b45-9a08-21ab79b417f3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:33.680757 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6d276216-f95c-4b45-9a08-21ab79b417f3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.181763 Aug 10 17:18:33.681319 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 293/594] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:33 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:33.688169 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d9f3911b-7ace-41e3-8f63-4053acc3c860 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:33.692075 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d9f3911b-7ace-41e3-8f63-4053acc3c860 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:33.702508 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d9f3911b-7ace-41e3-8f63-4053acc3c860 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:33.702983 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d9f3911b-7ace-41e3-8f63-4053acc3c860 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:33.703424 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d9f3911b-7ace-41e3-8f63-4053acc3c860 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:33.704121 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d9f3911b-7ace-41e3-8f63-4053acc3c860 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:33.704576 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d9f3911b-7ace-41e3-8f63-4053acc3c860 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:33.705002 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d9f3911b-7ace-41e3-8f63-4053acc3c860 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:33.741433 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d9f3911b-7ace-41e3-8f63-4053acc3c860 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056429 Aug 10 17:18:33.741433 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 294/595] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:18:33 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:18:34.448190 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9cf03fb2-392b-4272-9d7b-55b591fc7cb8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "POST /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.607738 Aug 10 17:18:34.450491 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 302/596] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 17:18:32 2022] POST /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments => generated 194 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:18:34.522319 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ab14bd91-2bb8-4c42-98cc-19c89cfa3132 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:34.522986 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ab14bd91-2bb8-4c42-98cc-19c89cfa3132 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:34.529639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab14bd91-2bb8-4c42-98cc-19c89cfa3132 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:34.530113 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab14bd91-2bb8-4c42-98cc-19c89cfa3132 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:34.530584 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab14bd91-2bb8-4c42-98cc-19c89cfa3132 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:34.531287 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab14bd91-2bb8-4c42-98cc-19c89cfa3132 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:34.531714 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab14bd91-2bb8-4c42-98cc-19c89cfa3132 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:34.532129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab14bd91-2bb8-4c42-98cc-19c89cfa3132 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:34.682035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ab14bd91-2bb8-4c42-98cc-19c89cfa3132 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:34.695245 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ab14bd91-2bb8-4c42-98cc-19c89cfa3132 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1677 microversion: 2.1 time: 0.177078 Aug 10 17:18:34.696218 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 295/597] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:34 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:34.705695 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-167bb472-d200-4909-9c40-ee76613b69c3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:34.707306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-167bb472-d200-4909-9c40-ee76613b69c3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:34.714134 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-167bb472-d200-4909-9c40-ee76613b69c3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:34.714931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-167bb472-d200-4909-9c40-ee76613b69c3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:34.715523 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-167bb472-d200-4909-9c40-ee76613b69c3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:34.716412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-167bb472-d200-4909-9c40-ee76613b69c3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:34.716966 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-167bb472-d200-4909-9c40-ee76613b69c3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:34.717500 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-167bb472-d200-4909-9c40-ee76613b69c3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:34.753424 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bc2b0509-acfb-4129-97e3-caff6dda4715 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:34.756095 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-bc2b0509-acfb-4129-97e3-caff6dda4715 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:34.762842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bc2b0509-acfb-4129-97e3-caff6dda4715 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:34.763570 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bc2b0509-acfb-4129-97e3-caff6dda4715 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:34.764002 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bc2b0509-acfb-4129-97e3-caff6dda4715 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:34.764749 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bc2b0509-acfb-4129-97e3-caff6dda4715 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:34.765201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bc2b0509-acfb-4129-97e3-caff6dda4715 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:34.765616 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bc2b0509-acfb-4129-97e3-caff6dda4715 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:34.808544 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bc2b0509-acfb-4129-97e3-caff6dda4715 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054769 Aug 10 17:18:34.808544 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 296/598] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:18:34 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:18:34.863267 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-167bb472-d200-4909-9c40-ee76613b69c3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:34.871880 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-167bb472-d200-4909-9c40-ee76613b69c3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:34.873492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-167bb472-d200-4909-9c40-ee76613b69c3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:34.874765 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-167bb472-d200-4909-9c40-ee76613b69c3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.173624 Aug 10 17:18:34.875405 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 303/599] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:34 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:35.717612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0577628e-5c82-42ac-a1bf-97b890ac8f43 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:35.718310 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0577628e-5c82-42ac-a1bf-97b890ac8f43 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:35.726384 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0577628e-5c82-42ac-a1bf-97b890ac8f43 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:35.729275 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0577628e-5c82-42ac-a1bf-97b890ac8f43 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:35.729275 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0577628e-5c82-42ac-a1bf-97b890ac8f43 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:35.729275 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0577628e-5c82-42ac-a1bf-97b890ac8f43 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:35.729275 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0577628e-5c82-42ac-a1bf-97b890ac8f43 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:35.729826 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0577628e-5c82-42ac-a1bf-97b890ac8f43 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:35.815182 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-95590e3f-2d10-49c1-86b7-a8ae0deb92a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:35.818229 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-95590e3f-2d10-49c1-86b7-a8ae0deb92a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:35.825804 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95590e3f-2d10-49c1-86b7-a8ae0deb92a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:35.826715 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95590e3f-2d10-49c1-86b7-a8ae0deb92a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:35.827924 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95590e3f-2d10-49c1-86b7-a8ae0deb92a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:35.828842 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95590e3f-2d10-49c1-86b7-a8ae0deb92a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:35.829592 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95590e3f-2d10-49c1-86b7-a8ae0deb92a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:35.830032 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95590e3f-2d10-49c1-86b7-a8ae0deb92a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:35.867103 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-95590e3f-2d10-49c1-86b7-a8ae0deb92a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051630 Aug 10 17:18:35.867103 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 304/600] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:18:35 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:18:35.888172 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0577628e-5c82-42ac-a1bf-97b890ac8f43 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:35.896371 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0577628e-5c82-42ac-a1bf-97b890ac8f43 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1677 microversion: 2.1 time: 0.182585 Aug 10 17:18:35.897113 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 297/601] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:35 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:35.900365 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-672897a4-76ef-449e-9f52-9254092af3d2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:35.900964 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-672897a4-76ef-449e-9f52-9254092af3d2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:35.907332 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-672897a4-76ef-449e-9f52-9254092af3d2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:35.907332 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-672897a4-76ef-449e-9f52-9254092af3d2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:35.907762 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-672897a4-76ef-449e-9f52-9254092af3d2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:35.908356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-672897a4-76ef-449e-9f52-9254092af3d2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:35.908809 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-672897a4-76ef-449e-9f52-9254092af3d2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:35.909361 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-672897a4-76ef-449e-9f52-9254092af3d2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:36.051573 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-672897a4-76ef-449e-9f52-9254092af3d2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:36.059930 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-672897a4-76ef-449e-9f52-9254092af3d2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:36.061450 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-672897a4-76ef-449e-9f52-9254092af3d2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:36.062623 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-672897a4-76ef-449e-9f52-9254092af3d2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.167589 Aug 10 17:18:36.063175 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 305/602] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:35 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:18:36.286030 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-80b9b19d-495c-4758-9e80-c6b055fc16a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:36.286844 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-80b9b19d-495c-4758-9e80-c6b055fc16a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:36.293107 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-80b9b19d-495c-4758-9e80-c6b055fc16a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:36.293602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-80b9b19d-495c-4758-9e80-c6b055fc16a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:36.294086 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-80b9b19d-495c-4758-9e80-c6b055fc16a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:36.294840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-80b9b19d-495c-4758-9e80-c6b055fc16a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:36.295300 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-80b9b19d-495c-4758-9e80-c6b055fc16a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:36.295730 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-80b9b19d-495c-4758-9e80-c6b055fc16a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:36.321781 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-80b9b19d-495c-4758-9e80-c6b055fc16a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:18:36.626416 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-80b9b19d-495c-4758-9e80-c6b055fc16a6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 204 len: 0 microversion: 2.1 time: 0.344332 Aug 10 17:18:36.627072 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 298/603] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:18:36 2022] DELETE /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:18:36.636244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-48a9dcda-5033-4067-8619-20bb768dbf62 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:36.636887 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-48a9dcda-5033-4067-8619-20bb768dbf62 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:36.638886 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=48 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:18:36.643613 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48a9dcda-5033-4067-8619-20bb768dbf62 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:36.644102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48a9dcda-5033-4067-8619-20bb768dbf62 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:36.644544 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48a9dcda-5033-4067-8619-20bb768dbf62 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:36.645247 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48a9dcda-5033-4067-8619-20bb768dbf62 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:36.645742 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48a9dcda-5033-4067-8619-20bb768dbf62 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:36.646191 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48a9dcda-5033-4067-8619-20bb768dbf62 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:36.796914 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-48a9dcda-5033-4067-8619-20bb768dbf62 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:36.804511 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-48a9dcda-5033-4067-8619-20bb768dbf62 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1681 microversion: 2.1 time: 0.172454 Aug 10 17:18:36.815387 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 306/604] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:36 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:36.907733 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-df9c1966-951c-4a19-aa8c-1e1987f5c56a req-dfffd8a0-e987-4e38-8152-f1ad74044e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e46673f-6139-4b97-b57a-b65886eb16b1", "name": "network-vif-plugged", "status": "completed", "tag": "65857e53-de9a-43a1-9362-2d62644ab14a"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:18:36.920771 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-df9c1966-951c-4a19-aa8c-1e1987f5c56a req-dfffd8a0-e987-4e38-8152-f1ad74044e3c service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:36.921266 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-df9c1966-951c-4a19-aa8c-1e1987f5c56a req-dfffd8a0-e987-4e38-8152-f1ad74044e3c service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:36.921468 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e9d7ad6a-4aa3-478f-9beb-8417bc00d8e4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:36.921766 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-df9c1966-951c-4a19-aa8c-1e1987f5c56a req-dfffd8a0-e987-4e38-8152-f1ad74044e3c service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:36.922479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e9d7ad6a-4aa3-478f-9beb-8417bc00d8e4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:36.931568 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9d7ad6a-4aa3-478f-9beb-8417bc00d8e4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:36.932202 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9d7ad6a-4aa3-478f-9beb-8417bc00d8e4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:36.932820 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9d7ad6a-4aa3-478f-9beb-8417bc00d8e4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:36.933616 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9d7ad6a-4aa3-478f-9beb-8417bc00d8e4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:36.934083 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9d7ad6a-4aa3-478f-9beb-8417bc00d8e4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:36.934546 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9d7ad6a-4aa3-478f-9beb-8417bc00d8e4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:36.935016 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-df9c1966-951c-4a19-aa8c-1e1987f5c56a req-dfffd8a0-e987-4e38-8152-f1ad74044e3c service nova] Creating event network-vif-plugged:65857e53-de9a-43a1-9362-2d62644ab14a for instance 1e46673f-6139-4b97-b57a-b65886eb16b1 on hv-cinder-85272 Aug 10 17:18:36.940604 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-df9c1966-951c-4a19-aa8c-1e1987f5c56a req-dfffd8a0-e987-4e38-8152-f1ad74044e3c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037476 Aug 10 17:18:36.941210 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 299/605] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:18:37.079381 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e9d7ad6a-4aa3-478f-9beb-8417bc00d8e4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:37.087598 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9ab7b71d-8951-46c7-aa2c-bb0e73898b04 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:37.087982 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e9d7ad6a-4aa3-478f-9beb-8417bc00d8e4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1677 microversion: 2.1 time: 0.172678 Aug 10 17:18:37.088472 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9ab7b71d-8951-46c7-aa2c-bb0e73898b04 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:37.088568 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 307/606] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:36 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:37.095434 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9ab7b71d-8951-46c7-aa2c-bb0e73898b04 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:37.095925 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9ab7b71d-8951-46c7-aa2c-bb0e73898b04 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:37.096366 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9ab7b71d-8951-46c7-aa2c-bb0e73898b04 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:37.097068 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9ab7b71d-8951-46c7-aa2c-bb0e73898b04 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:37.097533 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9ab7b71d-8951-46c7-aa2c-bb0e73898b04 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:37.097961 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9ab7b71d-8951-46c7-aa2c-bb0e73898b04 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:37.234764 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9ab7b71d-8951-46c7-aa2c-bb0e73898b04 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:37.243438 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9ab7b71d-8951-46c7-aa2c-bb0e73898b04 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:37.244927 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9ab7b71d-8951-46c7-aa2c-bb0e73898b04 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:37.246069 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9ab7b71d-8951-46c7-aa2c-bb0e73898b04 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.163713 Aug 10 17:18:37.246886 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 300/607] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:37 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:18:37.826899 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-326ec3cb-c792-4c55-81ff-c57d239792c0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:37.827711 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-326ec3cb-c792-4c55-81ff-c57d239792c0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:37.839895 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-326ec3cb-c792-4c55-81ff-c57d239792c0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:37.839895 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-326ec3cb-c792-4c55-81ff-c57d239792c0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:37.839895 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-326ec3cb-c792-4c55-81ff-c57d239792c0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:37.839895 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-326ec3cb-c792-4c55-81ff-c57d239792c0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:37.840262 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-326ec3cb-c792-4c55-81ff-c57d239792c0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:37.840262 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-326ec3cb-c792-4c55-81ff-c57d239792c0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:37.986892 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-326ec3cb-c792-4c55-81ff-c57d239792c0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:37.994916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-326ec3cb-c792-4c55-81ff-c57d239792c0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1681 microversion: 2.1 time: 0.171747 Aug 10 17:18:37.995512 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 308/608] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:37 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:38.109388 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-09968e37-dcca-48fc-9e18-81de1d8d9b52 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:38.110099 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-09968e37-dcca-48fc-9e18-81de1d8d9b52 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:38.117375 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09968e37-dcca-48fc-9e18-81de1d8d9b52 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:38.117863 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09968e37-dcca-48fc-9e18-81de1d8d9b52 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:38.118306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09968e37-dcca-48fc-9e18-81de1d8d9b52 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:38.119031 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09968e37-dcca-48fc-9e18-81de1d8d9b52 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:38.119487 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09968e37-dcca-48fc-9e18-81de1d8d9b52 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:38.119915 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09968e37-dcca-48fc-9e18-81de1d8d9b52 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:38.272330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e472e846-43f0-4856-9eed-fef7ae5a4075 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:38.273339 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e472e846-43f0-4856-9eed-fef7ae5a4075 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:38.282133 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e472e846-43f0-4856-9eed-fef7ae5a4075 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:38.283173 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e472e846-43f0-4856-9eed-fef7ae5a4075 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:38.283791 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e472e846-43f0-4856-9eed-fef7ae5a4075 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:38.284901 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e472e846-43f0-4856-9eed-fef7ae5a4075 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:38.285356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e472e846-43f0-4856-9eed-fef7ae5a4075 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:38.285781 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e472e846-43f0-4856-9eed-fef7ae5a4075 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:38.287225 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-09968e37-dcca-48fc-9e18-81de1d8d9b52 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:38.300422 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-09968e37-dcca-48fc-9e18-81de1d8d9b52 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1677 microversion: 2.1 time: 0.194922 Aug 10 17:18:38.301020 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 301/609] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:38 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:18:38.444996 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e472e846-43f0-4856-9eed-fef7ae5a4075 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:38.453686 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e472e846-43f0-4856-9eed-fef7ae5a4075 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:38.455226 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e472e846-43f0-4856-9eed-fef7ae5a4075 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:38.456402 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e472e846-43f0-4856-9eed-fef7ae5a4075 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.190923 Aug 10 17:18:38.456958 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 309/610] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:38 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:39.017226 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-85c32eb9-6ecd-4d47-a41b-58fc4e2d9b65 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:39.017838 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-85c32eb9-6ecd-4d47-a41b-58fc4e2d9b65 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:39.025753 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-85c32eb9-6ecd-4d47-a41b-58fc4e2d9b65 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:39.026619 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-85c32eb9-6ecd-4d47-a41b-58fc4e2d9b65 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:39.027363 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-85c32eb9-6ecd-4d47-a41b-58fc4e2d9b65 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:39.028085 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-85c32eb9-6ecd-4d47-a41b-58fc4e2d9b65 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:39.028545 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-85c32eb9-6ecd-4d47-a41b-58fc4e2d9b65 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:39.028959 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-85c32eb9-6ecd-4d47-a41b-58fc4e2d9b65 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:39.174963 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-85c32eb9-6ecd-4d47-a41b-58fc4e2d9b65 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:39.183255 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-85c32eb9-6ecd-4d47-a41b-58fc4e2d9b65 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1681 microversion: 2.1 time: 0.170023 Aug 10 17:18:39.184204 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 302/611] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:39 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:39.325687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a85c2a65-b8f5-462f-80d1-98f0c6576959 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:39.326992 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a85c2a65-b8f5-462f-80d1-98f0c6576959 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:39.334754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a85c2a65-b8f5-462f-80d1-98f0c6576959 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:39.335259 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a85c2a65-b8f5-462f-80d1-98f0c6576959 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:39.335702 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a85c2a65-b8f5-462f-80d1-98f0c6576959 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:39.336437 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a85c2a65-b8f5-462f-80d1-98f0c6576959 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:39.337080 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a85c2a65-b8f5-462f-80d1-98f0c6576959 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:39.337501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a85c2a65-b8f5-462f-80d1-98f0c6576959 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:39.480834 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0b995e28-0c9e-4e49-a00e-c040088c08ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:39.481512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0b995e28-0c9e-4e49-a00e-c040088c08ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:39.493284 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b995e28-0c9e-4e49-a00e-c040088c08ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:39.494193 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b995e28-0c9e-4e49-a00e-c040088c08ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:39.495907 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b995e28-0c9e-4e49-a00e-c040088c08ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:39.497069 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b995e28-0c9e-4e49-a00e-c040088c08ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:39.497726 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b995e28-0c9e-4e49-a00e-c040088c08ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:39.499153 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b995e28-0c9e-4e49-a00e-c040088c08ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:39.506179 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a85c2a65-b8f5-462f-80d1-98f0c6576959 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:39.519978 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a85c2a65-b8f5-462f-80d1-98f0c6576959 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1677 microversion: 2.1 time: 0.198102 Aug 10 17:18:39.537719 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 310/612] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:39 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:39.696877 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0b995e28-0c9e-4e49-a00e-c040088c08ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:39.705738 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0b995e28-0c9e-4e49-a00e-c040088c08ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:39.707579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0b995e28-0c9e-4e49-a00e-c040088c08ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:39.709517 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0b995e28-0c9e-4e49-a00e-c040088c08ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.233851 Aug 10 17:18:39.710154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 303/613] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:39 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:18:39.753182 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-4b65bb23-ef89-468f-bae5-674eb995bbb9 req-2f91c0d1-b28a-451c-b240-20f119de6d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57e6be9-21bd-4903-a43c-425a17bf4029", "name": "network-vif-deleted", "tag": "0726fc1d-a4ae-43f9-bb6e-44f5614c267e"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:18:39.773553 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-4b65bb23-ef89-468f-bae5-674eb995bbb9 req-2f91c0d1-b28a-451c-b240-20f119de6d3c service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:39.773553 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-4b65bb23-ef89-468f-bae5-674eb995bbb9 req-2f91c0d1-b28a-451c-b240-20f119de6d3c service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:39.773553 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-4b65bb23-ef89-468f-bae5-674eb995bbb9 req-2f91c0d1-b28a-451c-b240-20f119de6d3c service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:39.789645 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-4b65bb23-ef89-468f-bae5-674eb995bbb9 req-2f91c0d1-b28a-451c-b240-20f119de6d3c service nova] Creating event network-vif-deleted:0726fc1d-a4ae-43f9-bb6e-44f5614c267e for instance a57e6be9-21bd-4903-a43c-425a17bf4029 on hv-cinder-85272 Aug 10 17:18:39.800412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-4b65bb23-ef89-468f-bae5-674eb995bbb9 req-2f91c0d1-b28a-451c-b240-20f119de6d3c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047940 Aug 10 17:18:39.800916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 311/614] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:18:40.207369 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3c40bcc6-d10f-4c44-81cc-0b7152cc0a81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:40.209062 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3c40bcc6-d10f-4c44-81cc-0b7152cc0a81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:40.219415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c40bcc6-d10f-4c44-81cc-0b7152cc0a81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:40.220180 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c40bcc6-d10f-4c44-81cc-0b7152cc0a81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:40.220810 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c40bcc6-d10f-4c44-81cc-0b7152cc0a81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:40.221728 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c40bcc6-d10f-4c44-81cc-0b7152cc0a81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:40.222619 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c40bcc6-d10f-4c44-81cc-0b7152cc0a81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:40.225130 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c40bcc6-d10f-4c44-81cc-0b7152cc0a81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:40.274190 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c40bcc6-d10f-4c44-81cc-0b7152cc0a81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:40.274968 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c40bcc6-d10f-4c44-81cc-0b7152cc0a81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:40.275572 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c40bcc6-d10f-4c44-81cc-0b7152cc0a81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:40.276031 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-3c40bcc6-d10f-4c44-81cc-0b7152cc0a81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lazy-loading 'fault' on Instance uuid a57e6be9-21bd-4903-a43c-425a17bf4029 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:18:40.327596 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3c40bcc6-d10f-4c44-81cc-0b7152cc0a81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:40.335785 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3c40bcc6-d10f-4c44-81cc-0b7152cc0a81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1332 microversion: 2.1 time: 0.133691 Aug 10 17:18:40.336352 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 304/615] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:40 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1332 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:40.548214 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b144a3b8-b736-4863-bb69-2e0180927152 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:40.549170 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b144a3b8-b736-4863-bb69-2e0180927152 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:40.556794 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b144a3b8-b736-4863-bb69-2e0180927152 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:40.557297 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b144a3b8-b736-4863-bb69-2e0180927152 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:40.557738 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b144a3b8-b736-4863-bb69-2e0180927152 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:40.558698 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b144a3b8-b736-4863-bb69-2e0180927152 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:40.559355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b144a3b8-b736-4863-bb69-2e0180927152 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:40.559790 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b144a3b8-b736-4863-bb69-2e0180927152 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:40.564783 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:18:40.720413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b144a3b8-b736-4863-bb69-2e0180927152 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:40.733749 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a1a6cb2f-6272-4a22-8ed8-d3aa969a70d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:40.734709 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a1a6cb2f-6272-4a22-8ed8-d3aa969a70d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:40.741893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a1a6cb2f-6272-4a22-8ed8-d3aa969a70d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:40.742436 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a1a6cb2f-6272-4a22-8ed8-d3aa969a70d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:40.742890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a1a6cb2f-6272-4a22-8ed8-d3aa969a70d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:40.743626 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a1a6cb2f-6272-4a22-8ed8-d3aa969a70d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:40.744085 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a1a6cb2f-6272-4a22-8ed8-d3aa969a70d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:40.744569 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a1a6cb2f-6272-4a22-8ed8-d3aa969a70d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:40.748341 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b144a3b8-b736-4863-bb69-2e0180927152 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1677 microversion: 2.1 time: 0.204802 Aug 10 17:18:40.749905 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 312/616] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:40 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1677 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:18:40.915589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a1a6cb2f-6272-4a22-8ed8-d3aa969a70d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:40.924974 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a1a6cb2f-6272-4a22-8ed8-d3aa969a70d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:40.927372 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a1a6cb2f-6272-4a22-8ed8-d3aa969a70d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:40.929476 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a1a6cb2f-6272-4a22-8ed8-d3aa969a70d0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.200327 Aug 10 17:18:40.930053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 305/617] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:40 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:18:41.361153 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ecec7e2c-12ee-4d6d-ae12-5f8f1d0a0af1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:41.361764 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ecec7e2c-12ee-4d6d-ae12-5f8f1d0a0af1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:41.368481 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ecec7e2c-12ee-4d6d-ae12-5f8f1d0a0af1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:41.369062 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ecec7e2c-12ee-4d6d-ae12-5f8f1d0a0af1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:41.369734 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ecec7e2c-12ee-4d6d-ae12-5f8f1d0a0af1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:41.370546 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ecec7e2c-12ee-4d6d-ae12-5f8f1d0a0af1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:41.371036 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ecec7e2c-12ee-4d6d-ae12-5f8f1d0a0af1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:41.371492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ecec7e2c-12ee-4d6d-ae12-5f8f1d0a0af1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:41.408797 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ecec7e2c-12ee-4d6d-ae12-5f8f1d0a0af1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:41.409492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ecec7e2c-12ee-4d6d-ae12-5f8f1d0a0af1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:41.410121 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ecec7e2c-12ee-4d6d-ae12-5f8f1d0a0af1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:41.410617 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-ecec7e2c-12ee-4d6d-ae12-5f8f1d0a0af1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lazy-loading 'fault' on Instance uuid a57e6be9-21bd-4903-a43c-425a17bf4029 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:18:41.459057 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ecec7e2c-12ee-4d6d-ae12-5f8f1d0a0af1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:41.466689 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ecec7e2c-12ee-4d6d-ae12-5f8f1d0a0af1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 200 len: 1332 microversion: 2.1 time: 0.110150 Aug 10 17:18:41.467259 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 313/618] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:41 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:41.774264 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-42038ba9-bd16-44fe-bb5f-05a761bb20b5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:41.774918 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-42038ba9-bd16-44fe-bb5f-05a761bb20b5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:41.787123 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-42038ba9-bd16-44fe-bb5f-05a761bb20b5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:41.788456 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-42038ba9-bd16-44fe-bb5f-05a761bb20b5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:41.789116 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-42038ba9-bd16-44fe-bb5f-05a761bb20b5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:41.790185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-42038ba9-bd16-44fe-bb5f-05a761bb20b5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:41.796297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-42038ba9-bd16-44fe-bb5f-05a761bb20b5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:41.796764 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-42038ba9-bd16-44fe-bb5f-05a761bb20b5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:41.944124 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-42038ba9-bd16-44fe-bb5f-05a761bb20b5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:41.953104 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-022a6d29-d8b5-4da6-8d79-0ee038bd7666 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:41.954321 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-022a6d29-d8b5-4da6-8d79-0ee038bd7666 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:41.974494 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-022a6d29-d8b5-4da6-8d79-0ee038bd7666 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:41.974494 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-022a6d29-d8b5-4da6-8d79-0ee038bd7666 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:41.974894 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-42038ba9-bd16-44fe-bb5f-05a761bb20b5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1677 microversion: 2.1 time: 0.193184 Aug 10 17:18:41.974980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-022a6d29-d8b5-4da6-8d79-0ee038bd7666 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:41.975057 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 306/619] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:41 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:41.975141 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-022a6d29-d8b5-4da6-8d79-0ee038bd7666 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:41.975141 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-022a6d29-d8b5-4da6-8d79-0ee038bd7666 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:41.975141 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-022a6d29-d8b5-4da6-8d79-0ee038bd7666 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:42.139122 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-022a6d29-d8b5-4da6-8d79-0ee038bd7666 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:42.148447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-022a6d29-d8b5-4da6-8d79-0ee038bd7666 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:42.150066 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-022a6d29-d8b5-4da6-8d79-0ee038bd7666 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:42.151493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-022a6d29-d8b5-4da6-8d79-0ee038bd7666 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1806 microversion: 2.20 time: 0.202476 Aug 10 17:18:42.151916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 314/620] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:41 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:18:42.487874 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-70851e76-626a-4f80-b441-1be5bbfa07fb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:42.488573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-70851e76-626a-4f80-b441-1be5bbfa07fb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:42.498057 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70851e76-626a-4f80-b441-1be5bbfa07fb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:42.498057 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70851e76-626a-4f80-b441-1be5bbfa07fb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:42.498057 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70851e76-626a-4f80-b441-1be5bbfa07fb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:42.498057 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70851e76-626a-4f80-b441-1be5bbfa07fb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:42.498547 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70851e76-626a-4f80-b441-1be5bbfa07fb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:42.498547 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70851e76-626a-4f80-b441-1be5bbfa07fb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:42.512596 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-70851e76-626a-4f80-b441-1be5bbfa07fb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] HTTP exception thrown: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-70851e76-626a-4f80-b441-1be5bbfa07fb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Request method failure captured: Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 HTTP/1.1 Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-d1JeRL-7M2oDNopDjpZUxB7lCyD6gM7mAKQjs1c_tbDXZUJQxtkwNVWBVbSkOO7nl_NecmWamydXOiC8XB5d0eHDfa5nNH50PHdLvbF4dkN-n17ApWL5TP6WLuf0j7atmVYlNbqIzfOOdPkW7Q67otg7JGz72UDMA9zNteHBnnxaI Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:18:42.514257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:18:42.516261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cfac2c11f1b24456a5a9efaa9112e281", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}] Aug 10 17:18:42.516261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:18:42.516261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:18:42.516261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:18:42.516261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:18:42.516261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:18:42.516261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:18:42.516261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 48feb2fc02f04e739c5e1bf7d68baa16 Aug 10 17:18:42.516261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:18:42.516261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:18:42.516261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:18:42.516261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': 'a57e6be9-21bd-4903-a43c-425a17bf4029'} Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:18:42.517185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:18:42.518656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:18:42.520625 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-70851e76-626a-4f80-b441-1be5bbfa07fb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Returning 404 to user: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:18:42.520625 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-70851e76-626a-4f80-b441-1be5bbfa07fb tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 404 len: 111 microversion: 2.1 time: 0.031798 Aug 10 17:18:42.520625 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 307/621] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:42 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:18:42.525501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cee69f3c-7367-4380-a276-d81122c02a68 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '.version_select at 0x7f7eb9fe05e0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:43.065145 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cee69f3c-7367-4380-a276-d81122c02a68 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503583688" status: 202 len: 0 microversion: 2.1 time: 0.091000 Aug 10 17:18:43.065145 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 315/622] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 10 17:18:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503583688 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:18:43.066041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ca7de4eb-00dd-4cda-bc9d-f5852ed1a93b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:43.066041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ca7de4eb-00dd-4cda-bc9d-f5852ed1a93b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:43.066041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca7de4eb-00dd-4cda-bc9d-f5852ed1a93b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:43.066041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca7de4eb-00dd-4cda-bc9d-f5852ed1a93b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:43.066902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca7de4eb-00dd-4cda-bc9d-f5852ed1a93b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:43.066902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca7de4eb-00dd-4cda-bc9d-f5852ed1a93b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:43.066902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca7de4eb-00dd-4cda-bc9d-f5852ed1a93b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:43.066902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca7de4eb-00dd-4cda-bc9d-f5852ed1a93b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:43.067201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:18:43.178719 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ca7de4eb-00dd-4cda-bc9d-f5852ed1a93b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:43.178719 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ca7de4eb-00dd-4cda-bc9d-f5852ed1a93b tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1654 microversion: 2.1 time: 0.191742 Aug 10 17:18:43.178719 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 308/623] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:42 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1654 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:43.184241 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-68947f6a-fcbf-49a0-89c2-f81a63d3959c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:43.184862 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-68947f6a-fcbf-49a0-89c2-f81a63d3959c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:43.194593 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b14ddd0f-f963-4bb9-b9e3-2bf8f042cd72 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:18:43.195297 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68947f6a-fcbf-49a0-89c2-f81a63d3959c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:43.196019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68947f6a-fcbf-49a0-89c2-f81a63d3959c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:43.196567 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68947f6a-fcbf-49a0-89c2-f81a63d3959c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:43.197411 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68947f6a-fcbf-49a0-89c2-f81a63d3959c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:43.197988 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68947f6a-fcbf-49a0-89c2-f81a63d3959c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:43.198554 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68947f6a-fcbf-49a0-89c2-f81a63d3959c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:43.200936 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b14ddd0f-f963-4bb9-b9e3-2bf8f042cd72 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:43.201339 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b14ddd0f-f963-4bb9-b9e3-2bf8f042cd72 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:43.201974 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b14ddd0f-f963-4bb9-b9e3-2bf8f042cd72 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:43.231943 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b14ddd0f-f963-4bb9-b9e3-2bf8f042cd72 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Going to try to start instance {{(pid=121231) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 17:18:43.359057 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-68947f6a-fcbf-49a0-89c2-f81a63d3959c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:43.369266 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-68947f6a-fcbf-49a0-89c2-f81a63d3959c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:43.372585 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-68947f6a-fcbf-49a0-89c2-f81a63d3959c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:43.372585 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-68947f6a-fcbf-49a0-89c2-f81a63d3959c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1793 microversion: 2.20 time: 0.192272 Aug 10 17:18:43.372792 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 316/624] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:18:43 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1793 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:18:43.378219 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e0edcfdf-dfd5-4228-aa24-ef4edab53033 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:18:43.381681 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e0edcfdf-dfd5-4228-aa24-ef4edab53033 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:43.388128 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0edcfdf-dfd5-4228-aa24-ef4edab53033 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:43.388902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0edcfdf-dfd5-4228-aa24-ef4edab53033 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:43.389351 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0edcfdf-dfd5-4228-aa24-ef4edab53033 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:43.390064 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0edcfdf-dfd5-4228-aa24-ef4edab53033 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:43.390557 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0edcfdf-dfd5-4228-aa24-ef4edab53033 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:43.390993 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0edcfdf-dfd5-4228-aa24-ef4edab53033 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:43.416836 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-e0edcfdf-dfd5-4228-aa24-ef4edab53033 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lazy-loading 'flavor' on Instance uuid 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:18:43.522498 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b14ddd0f-f963-4bb9-b9e3-2bf8f042cd72 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "POST /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/action" status: 202 len: 0 microversion: 2.1 time: 0.332302 Aug 10 17:18:43.527021 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 309/625] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:18:43 2022] POST /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:18:43.533884 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c1ea3477-7060-4a9a-8718-f6619d8bd947 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:43.534627 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c1ea3477-7060-4a9a-8718-f6619d8bd947 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:43.541330 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1ea3477-7060-4a9a-8718-f6619d8bd947 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:43.541892 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1ea3477-7060-4a9a-8718-f6619d8bd947 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:43.542343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1ea3477-7060-4a9a-8718-f6619d8bd947 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:43.543087 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1ea3477-7060-4a9a-8718-f6619d8bd947 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:43.543749 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1ea3477-7060-4a9a-8718-f6619d8bd947 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:43.544182 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1ea3477-7060-4a9a-8718-f6619d8bd947 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:43.717196 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c1ea3477-7060-4a9a-8718-f6619d8bd947 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:43.727994 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c1ea3477-7060-4a9a-8718-f6619d8bd947 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1663 microversion: 2.1 time: 0.199491 Aug 10 17:18:43.728589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 310/626] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:43 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1663 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:43.760150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3a7d616d-84d4-4387-bc3b-6418c2bd92f7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Action: 'create', calling method: .version_select at 0x7f7eb9eb2b80>, body: {"keypair": {"name": "tempest-keypair-39133218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhY4BT2+olS1CoG4Hwlm2p/DFmE7ywGJUnP96EZB2q7ZnrCxYI8FNbdVX4hNXKXPVJFcybVMHmavVDexH1j1xttyJLy0gCo/QrYqFMbb2io3nXjWqs3xw23NEaE8zwmOA=="}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:18:43.776489 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-3a7d616d-84d4-4387-bc3b-6418c2bd92f7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:18:43.780486 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-3a7d616d-84d4-4387-bc3b-6418c2bd92f7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for user 48feb2fc02f04e739c5e1bf7d68baa16 and project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:18:43.782969 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:18:43.902066 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3a7d616d-84d4-4387-bc3b-6418c2bd92f7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.147299 Aug 10 17:18:43.906528 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 311/627] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 17:18:43 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:18:43.963025 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e0edcfdf-dfd5-4228-aa24-ef4edab53033 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "POST /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/action" status: 200 len: 32 microversion: 2.1 time: 0.589037 Aug 10 17:18:43.963926 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 317/628] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:18:43 2022] POST /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/action => generated 32 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:18:43.974455 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-83b935ac-006f-4f66-8e6f-6b5784ff6ea9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:43.975462 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-83b935ac-006f-4f66-8e6f-6b5784ff6ea9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:43.981961 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-83b935ac-006f-4f66-8e6f-6b5784ff6ea9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:43.982503 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-83b935ac-006f-4f66-8e6f-6b5784ff6ea9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:43.982947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-83b935ac-006f-4f66-8e6f-6b5784ff6ea9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:43.983697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-83b935ac-006f-4f66-8e6f-6b5784ff6ea9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:43.984152 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-83b935ac-006f-4f66-8e6f-6b5784ff6ea9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:43.984586 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-83b935ac-006f-4f66-8e6f-6b5784ff6ea9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:44.164963 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-83b935ac-006f-4f66-8e6f-6b5784ff6ea9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:44.175324 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-83b935ac-006f-4f66-8e6f-6b5784ff6ea9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.205544 Aug 10 17:18:44.176266 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 312/629] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:43 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:44.752825 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f9572f09-fa55-428f-9ebd-f68e1ddb81bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:44.753528 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f9572f09-fa55-428f-9ebd-f68e1ddb81bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:44.761238 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9572f09-fa55-428f-9ebd-f68e1ddb81bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:44.761720 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9572f09-fa55-428f-9ebd-f68e1ddb81bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:44.762160 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9572f09-fa55-428f-9ebd-f68e1ddb81bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:44.763059 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9572f09-fa55-428f-9ebd-f68e1ddb81bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:44.763519 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9572f09-fa55-428f-9ebd-f68e1ddb81bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:44.764120 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9572f09-fa55-428f-9ebd-f68e1ddb81bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:44.910184 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f9572f09-fa55-428f-9ebd-f68e1ddb81bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:44.918571 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f9572f09-fa55-428f-9ebd-f68e1ddb81bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1663 microversion: 2.1 time: 0.170578 Aug 10 17:18:44.919157 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 318/630] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:44 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:45.197441 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-07a1f75d-b473-4371-a136-824b18c6b906 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:45.198238 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-07a1f75d-b473-4371-a136-824b18c6b906 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:45.205374 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-07a1f75d-b473-4371-a136-824b18c6b906 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:45.207449 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-07a1f75d-b473-4371-a136-824b18c6b906 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:45.207449 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-07a1f75d-b473-4371-a136-824b18c6b906 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:45.207449 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-07a1f75d-b473-4371-a136-824b18c6b906 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:45.207944 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-07a1f75d-b473-4371-a136-824b18c6b906 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:45.208568 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-07a1f75d-b473-4371-a136-824b18c6b906 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:45.353034 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-07a1f75d-b473-4371-a136-824b18c6b906 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:45.362143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-07a1f75d-b473-4371-a136-824b18c6b906 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.169412 Aug 10 17:18:45.363006 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 313/631] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:45 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:45.940989 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-04664ff5-04b6-4b0f-8eb4-7343075bfc01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:45.941605 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-04664ff5-04b6-4b0f-8eb4-7343075bfc01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:45.948457 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04664ff5-04b6-4b0f-8eb4-7343075bfc01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:45.948974 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04664ff5-04b6-4b0f-8eb4-7343075bfc01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:45.949437 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04664ff5-04b6-4b0f-8eb4-7343075bfc01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:45.950146 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04664ff5-04b6-4b0f-8eb4-7343075bfc01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:45.950941 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04664ff5-04b6-4b0f-8eb4-7343075bfc01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:45.951436 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04664ff5-04b6-4b0f-8eb4-7343075bfc01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:46.086549 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-04664ff5-04b6-4b0f-8eb4-7343075bfc01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:46.094281 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-04664ff5-04b6-4b0f-8eb4-7343075bfc01 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1667 microversion: 2.1 time: 0.157450 Aug 10 17:18:46.098609 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 319/632] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:45 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:46.386401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2e95dd06-3382-480d-a3a2-e2596be80e53 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:46.387614 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2e95dd06-3382-480d-a3a2-e2596be80e53 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:46.395752 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2e95dd06-3382-480d-a3a2-e2596be80e53 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:46.396569 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2e95dd06-3382-480d-a3a2-e2596be80e53 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:46.396933 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2e95dd06-3382-480d-a3a2-e2596be80e53 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:46.398198 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2e95dd06-3382-480d-a3a2-e2596be80e53 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:46.398735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2e95dd06-3382-480d-a3a2-e2596be80e53 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:46.399234 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2e95dd06-3382-480d-a3a2-e2596be80e53 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:46.560806 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2e95dd06-3382-480d-a3a2-e2596be80e53 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:46.569635 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2e95dd06-3382-480d-a3a2-e2596be80e53 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.188671 Aug 10 17:18:46.570222 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 314/633] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:46 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:46.712107 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2123660914", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df762851-303d-4aa3-ad7c-336bef1a7d98"}], "security_groups": [{"name": "tempest-securitygroup--1685749866"}], "key_name": "tempest-keypair-39133218", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:18:46.821134 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] validate_networks() for [('df762851-303d-4aa3-ad7c-336bef1a7d98', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:18:47.220034 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:18:47.220642 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:18:47.221085 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:18:47.221603 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:18:47.222218 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:18:47.232245 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:47.232735 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:47.233179 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:47.233915 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:47.234418 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:47.234828 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:47.252199 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:18:47.256716 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for user 48feb2fc02f04e739c5e1bf7d68baa16 and project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:18:47.269442 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:18:47.272593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:18:47.509056 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c2d76cd9-2293-43b0-87ce-3faec8dc2638 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.801260 Aug 10 17:18:47.510231 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 320/634] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:18:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:18:47.522714 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5a6aba8c-e271-4642-b0fe-9ca6e2688d82 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:47.523663 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5a6aba8c-e271-4642-b0fe-9ca6e2688d82 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:47.587869 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5a6aba8c-e271-4642-b0fe-9ca6e2688d82 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:47.594170 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8600e121-5fab-44f6-a121-60c9eac11fb0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:47.595660 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8600e121-5fab-44f6-a121-60c9eac11fb0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:47.596850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5a6aba8c-e271-4642-b0fe-9ca6e2688d82 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1240 microversion: 2.1 time: 0.078508 Aug 10 17:18:47.610384 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 315/635] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:47 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:47.635594 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8600e121-5fab-44f6-a121-60c9eac11fb0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:47.636090 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8600e121-5fab-44f6-a121-60c9eac11fb0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:47.636567 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8600e121-5fab-44f6-a121-60c9eac11fb0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:47.637284 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8600e121-5fab-44f6-a121-60c9eac11fb0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:47.637748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8600e121-5fab-44f6-a121-60c9eac11fb0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:47.638179 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8600e121-5fab-44f6-a121-60c9eac11fb0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:47.802193 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8600e121-5fab-44f6-a121-60c9eac11fb0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:47.809906 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8600e121-5fab-44f6-a121-60c9eac11fb0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.221455 Aug 10 17:18:47.810524 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 321/636] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:47 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:18:48.632268 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ee8b307a-efc7-4aeb-84c7-2aa3f4a5a3da tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:48.632878 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ee8b307a-efc7-4aeb-84c7-2aa3f4a5a3da tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:48.688028 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ee8b307a-efc7-4aeb-84c7-2aa3f4a5a3da tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:48.696121 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ee8b307a-efc7-4aeb-84c7-2aa3f4a5a3da tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1240 microversion: 2.1 time: 0.068528 Aug 10 17:18:48.696715 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 316/637] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:48 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:48.832038 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-62b322c3-d1c5-4110-9a9e-1d90c1093a48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:48.834092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-62b322c3-d1c5-4110-9a9e-1d90c1093a48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:48.841170 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62b322c3-d1c5-4110-9a9e-1d90c1093a48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:48.841733 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62b322c3-d1c5-4110-9a9e-1d90c1093a48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:48.842302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62b322c3-d1c5-4110-9a9e-1d90c1093a48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:48.843176 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62b322c3-d1c5-4110-9a9e-1d90c1093a48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:48.843698 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62b322c3-d1c5-4110-9a9e-1d90c1093a48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:48.844185 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62b322c3-d1c5-4110-9a9e-1d90c1093a48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:48.987288 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-62b322c3-d1c5-4110-9a9e-1d90c1093a48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:48.995837 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-62b322c3-d1c5-4110-9a9e-1d90c1093a48 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.167665 Aug 10 17:18:48.996412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 322/638] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:48 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:18:49.718110 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ff5b888c-bdf4-4545-a126-ddcd4dff0397 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:49.718756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ff5b888c-bdf4-4545-a126-ddcd4dff0397 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:49.726517 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff5b888c-bdf4-4545-a126-ddcd4dff0397 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:49.727024 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff5b888c-bdf4-4545-a126-ddcd4dff0397 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:49.727451 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff5b888c-bdf4-4545-a126-ddcd4dff0397 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:49.728137 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff5b888c-bdf4-4545-a126-ddcd4dff0397 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:49.728592 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff5b888c-bdf4-4545-a126-ddcd4dff0397 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:49.729014 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff5b888c-bdf4-4545-a126-ddcd4dff0397 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:49.794919 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ff5b888c-bdf4-4545-a126-ddcd4dff0397 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:49.802674 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ff5b888c-bdf4-4545-a126-ddcd4dff0397 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1292 microversion: 2.1 time: 0.088815 Aug 10 17:18:49.803256 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 317/639] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:49 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:50.017040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bc3dfc19-820c-4c20-ba5e-0b531c003975 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:50.017652 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bc3dfc19-820c-4c20-ba5e-0b531c003975 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:50.025088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc3dfc19-820c-4c20-ba5e-0b531c003975 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:50.025572 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc3dfc19-820c-4c20-ba5e-0b531c003975 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:50.026009 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc3dfc19-820c-4c20-ba5e-0b531c003975 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:50.026733 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc3dfc19-820c-4c20-ba5e-0b531c003975 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:50.027191 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc3dfc19-820c-4c20-ba5e-0b531c003975 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:50.027619 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc3dfc19-820c-4c20-ba5e-0b531c003975 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:50.161136 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bc3dfc19-820c-4c20-ba5e-0b531c003975 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:50.169294 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bc3dfc19-820c-4c20-ba5e-0b531c003975 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.156047 Aug 10 17:18:50.169866 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 323/640] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:50 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:50.823936 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b23a65f7-c46e-4aef-b83d-0f6bd3514efc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:50.824565 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b23a65f7-c46e-4aef-b83d-0f6bd3514efc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:50.831518 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b23a65f7-c46e-4aef-b83d-0f6bd3514efc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:50.832017 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b23a65f7-c46e-4aef-b83d-0f6bd3514efc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:50.832451 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b23a65f7-c46e-4aef-b83d-0f6bd3514efc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:50.833163 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b23a65f7-c46e-4aef-b83d-0f6bd3514efc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:50.833630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b23a65f7-c46e-4aef-b83d-0f6bd3514efc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:50.834126 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b23a65f7-c46e-4aef-b83d-0f6bd3514efc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:50.902755 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b23a65f7-c46e-4aef-b83d-0f6bd3514efc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:50.910921 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b23a65f7-c46e-4aef-b83d-0f6bd3514efc tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1298 microversion: 2.1 time: 0.090777 Aug 10 17:18:50.912072 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 318/641] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:50 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:51.113927 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-318839636", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:18:51.169357 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] validate_networks() for None {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:18:51.193342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e19a6b32-0054-49ef-8125-b117527fdde3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:51.195623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e19a6b32-0054-49ef-8125-b117527fdde3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:51.260178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e19a6b32-0054-49ef-8125-b117527fdde3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:51.260178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e19a6b32-0054-49ef-8125-b117527fdde3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:51.260178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e19a6b32-0054-49ef-8125-b117527fdde3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:51.260178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e19a6b32-0054-49ef-8125-b117527fdde3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:51.261399 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e19a6b32-0054-49ef-8125-b117527fdde3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:51.261399 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e19a6b32-0054-49ef-8125-b117527fdde3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:51.534291 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e19a6b32-0054-49ef-8125-b117527fdde3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:51.544367 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e19a6b32-0054-49ef-8125-b117527fdde3 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.356011 Aug 10 17:18:51.554708 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 319/642] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:51 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:51.566903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:18:51.567443 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:18:51.567929 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:18:51.568351 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:18:51.568939 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:18:51.577772 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:51.578255 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:51.578893 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:51.579629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:51.580092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:51.580590 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:51.599609 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Getting quotas for project 8dd5034c1fae4e369eb74852eb185468. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:18:51.603710 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Getting quotas for user baa1fc74f5fd48a7846d44337374d480 and project 8dd5034c1fae4e369eb74852eb185468. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:18:51.616283 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:18:51.618742 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:18:51.843951 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4d1ffa21-e824-45a5-a903-b0a46eff47d9 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733812 Aug 10 17:18:51.844597 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 324/643] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:18:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:18:51.856940 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-eda69f2c-1712-4b20-be7c-27159dab1aa5 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:51.857560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-eda69f2c-1712-4b20-be7c-27159dab1aa5 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:51.922037 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-eda69f2c-1712-4b20-be7c-27159dab1aa5 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:51.930764 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-eda69f2c-1712-4b20-be7c-27159dab1aa5 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1214 microversion: 2.1 time: 0.077745 Aug 10 17:18:51.931936 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 320/644] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:51 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:51.934750 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b464ba52-18ac-4be0-92c9-40bd93c871a0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:51.935575 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b464ba52-18ac-4be0-92c9-40bd93c871a0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:51.945923 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b464ba52-18ac-4be0-92c9-40bd93c871a0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:51.946779 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b464ba52-18ac-4be0-92c9-40bd93c871a0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:51.947144 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b464ba52-18ac-4be0-92c9-40bd93c871a0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:51.947904 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b464ba52-18ac-4be0-92c9-40bd93c871a0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:51.948421 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b464ba52-18ac-4be0-92c9-40bd93c871a0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:51.948800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b464ba52-18ac-4be0-92c9-40bd93c871a0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:52.104604 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b464ba52-18ac-4be0-92c9-40bd93c871a0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:52.112613 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b464ba52-18ac-4be0-92c9-40bd93c871a0 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1366 microversion: 2.1 time: 0.183788 Aug 10 17:18:52.113232 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 325/645] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:51 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:18:52.335483 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-07ce32b7-189e-4cc9-bb62-99857833815b req-192c4778-8502-41eb-932c-c2b106c09aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e755ffcc-1904-43e4-b6ab-5132e4e7294e", "tag": "c4c22bfb-50a9-4cd8-b161-a090e4995343"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:18:52.347384 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-07ce32b7-189e-4cc9-bb62-99857833815b req-192c4778-8502-41eb-932c-c2b106c09aa4 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:52.350803 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-07ce32b7-189e-4cc9-bb62-99857833815b req-192c4778-8502-41eb-932c-c2b106c09aa4 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:52.350803 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-07ce32b7-189e-4cc9-bb62-99857833815b req-192c4778-8502-41eb-932c-c2b106c09aa4 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:52.360528 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-07ce32b7-189e-4cc9-bb62-99857833815b req-192c4778-8502-41eb-932c-c2b106c09aa4 service nova] Creating event network-changed:c4c22bfb-50a9-4cd8-b161-a090e4995343 for instance e755ffcc-1904-43e4-b6ab-5132e4e7294e on hv-cinder-85272 Aug 10 17:18:52.366725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-07ce32b7-189e-4cc9-bb62-99857833815b req-192c4778-8502-41eb-932c-c2b106c09aa4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036997 Aug 10 17:18:52.367828 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 321/646] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:18:52.566797 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6f6e7013-3256-466a-8366-9730a09fd90b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:52.567653 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6f6e7013-3256-466a-8366-9730a09fd90b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:52.574618 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f6e7013-3256-466a-8366-9730a09fd90b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:52.575106 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f6e7013-3256-466a-8366-9730a09fd90b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:52.575541 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f6e7013-3256-466a-8366-9730a09fd90b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:52.576247 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f6e7013-3256-466a-8366-9730a09fd90b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:52.576702 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f6e7013-3256-466a-8366-9730a09fd90b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:52.577191 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f6e7013-3256-466a-8366-9730a09fd90b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:52.755426 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6f6e7013-3256-466a-8366-9730a09fd90b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:52.764609 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6f6e7013-3256-466a-8366-9730a09fd90b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.201564 Aug 10 17:18:52.766795 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 326/647] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:52 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:52.955171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9dfeb6b4-3238-4091-96cd-62a523fd4314 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:52.955864 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9dfeb6b4-3238-4091-96cd-62a523fd4314 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:53.011825 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9dfeb6b4-3238-4091-96cd-62a523fd4314 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:53.019035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9dfeb6b4-3238-4091-96cd-62a523fd4314 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1214 microversion: 2.1 time: 0.068056 Aug 10 17:18:53.019613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 322/648] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:52 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:53.137913 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5f6f5c6e-8558-4f6a-89ba-a4a7355d853d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:53.138668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5f6f5c6e-8558-4f6a-89ba-a4a7355d853d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:53.145117 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f6f5c6e-8558-4f6a-89ba-a4a7355d853d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:53.147102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f6f5c6e-8558-4f6a-89ba-a4a7355d853d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:53.147102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f6f5c6e-8558-4f6a-89ba-a4a7355d853d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:53.147102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f6f5c6e-8558-4f6a-89ba-a4a7355d853d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:53.147402 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f6f5c6e-8558-4f6a-89ba-a4a7355d853d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:53.147622 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f6f5c6e-8558-4f6a-89ba-a4a7355d853d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:53.309610 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5f6f5c6e-8558-4f6a-89ba-a4a7355d853d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:53.319639 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5f6f5c6e-8558-4f6a-89ba-a4a7355d853d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1366 microversion: 2.1 time: 0.185564 Aug 10 17:18:53.323881 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 327/649] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:53 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:53.787496 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8480199d-cad5-4746-a287-b185b4b9d902 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:53.788020 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8480199d-cad5-4746-a287-b185b4b9d902 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:53.795008 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8480199d-cad5-4746-a287-b185b4b9d902 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:53.795499 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8480199d-cad5-4746-a287-b185b4b9d902 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:53.795966 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8480199d-cad5-4746-a287-b185b4b9d902 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:53.796663 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8480199d-cad5-4746-a287-b185b4b9d902 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:53.797115 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8480199d-cad5-4746-a287-b185b4b9d902 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:53.797537 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8480199d-cad5-4746-a287-b185b4b9d902 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:53.931810 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8480199d-cad5-4746-a287-b185b4b9d902 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:53.939881 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8480199d-cad5-4746-a287-b185b4b9d902 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.156958 Aug 10 17:18:53.940482 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 323/650] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:53 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:54.041313 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6550c18b-b6fa-4d09-9a69-4c2c1b0020ba tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:54.041829 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6550c18b-b6fa-4d09-9a69-4c2c1b0020ba tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:54.048322 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6550c18b-b6fa-4d09-9a69-4c2c1b0020ba tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:54.048837 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6550c18b-b6fa-4d09-9a69-4c2c1b0020ba tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:54.049304 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6550c18b-b6fa-4d09-9a69-4c2c1b0020ba tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:54.049996 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6550c18b-b6fa-4d09-9a69-4c2c1b0020ba tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:54.050489 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6550c18b-b6fa-4d09-9a69-4c2c1b0020ba tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:54.050916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6550c18b-b6fa-4d09-9a69-4c2c1b0020ba tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:54.113434 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6550c18b-b6fa-4d09-9a69-4c2c1b0020ba tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:54.116996 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:18:54.126786 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6550c18b-b6fa-4d09-9a69-4c2c1b0020ba tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1218 microversion: 2.1 time: 0.089357 Aug 10 17:18:54.129926 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 328/651] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:54 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:54.398958 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d03908f1-042c-44a9-8f72-79287afe7f03 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:54.398958 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d03908f1-042c-44a9-8f72-79287afe7f03 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:54.398958 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d03908f1-042c-44a9-8f72-79287afe7f03 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:54.398958 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d03908f1-042c-44a9-8f72-79287afe7f03 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:54.399952 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d03908f1-042c-44a9-8f72-79287afe7f03 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:54.399952 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d03908f1-042c-44a9-8f72-79287afe7f03 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:54.399952 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d03908f1-042c-44a9-8f72-79287afe7f03 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:54.399952 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d03908f1-042c-44a9-8f72-79287afe7f03 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:54.709892 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d03908f1-042c-44a9-8f72-79287afe7f03 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:54.718117 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d03908f1-042c-44a9-8f72-79287afe7f03 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1366 microversion: 2.1 time: 0.381333 Aug 10 17:18:54.718772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 324/652] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:54 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:54.963011 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2f4770a6-9238-4700-bb0f-a26ddff1b4f7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:54.963541 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2f4770a6-9238-4700-bb0f-a26ddff1b4f7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:54.969985 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f4770a6-9238-4700-bb0f-a26ddff1b4f7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:54.970522 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f4770a6-9238-4700-bb0f-a26ddff1b4f7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:54.970965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f4770a6-9238-4700-bb0f-a26ddff1b4f7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:54.971676 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f4770a6-9238-4700-bb0f-a26ddff1b4f7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:54.972131 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f4770a6-9238-4700-bb0f-a26ddff1b4f7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:54.972562 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f4770a6-9238-4700-bb0f-a26ddff1b4f7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:55.105048 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2f4770a6-9238-4700-bb0f-a26ddff1b4f7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:55.113748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2f4770a6-9238-4700-bb0f-a26ddff1b4f7 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.155069 Aug 10 17:18:55.115197 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 329/653] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:54 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:55.148961 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-aa4d9573-38a5-4f22-8778-98c652e20d4e tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:55.149534 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-aa4d9573-38a5-4f22-8778-98c652e20d4e tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:55.156060 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aa4d9573-38a5-4f22-8778-98c652e20d4e tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:55.156544 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aa4d9573-38a5-4f22-8778-98c652e20d4e tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:55.156980 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aa4d9573-38a5-4f22-8778-98c652e20d4e tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:55.157673 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aa4d9573-38a5-4f22-8778-98c652e20d4e tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:55.158126 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aa4d9573-38a5-4f22-8778-98c652e20d4e tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:55.158585 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aa4d9573-38a5-4f22-8778-98c652e20d4e tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:55.226148 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-aa4d9573-38a5-4f22-8778-98c652e20d4e tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:55.230277 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-aa4d9573-38a5-4f22-8778-98c652e20d4e tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1266 microversion: 2.1 time: 0.085873 Aug 10 17:18:55.230899 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 325/654] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:55 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:55.741055 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-74dccc51-7f38-423c-8af8-f0bbef87732b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:55.741678 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-74dccc51-7f38-423c-8af8-f0bbef87732b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:55.747690 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74dccc51-7f38-423c-8af8-f0bbef87732b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:55.748179 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74dccc51-7f38-423c-8af8-f0bbef87732b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:55.748618 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74dccc51-7f38-423c-8af8-f0bbef87732b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:55.749319 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74dccc51-7f38-423c-8af8-f0bbef87732b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:55.749777 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74dccc51-7f38-423c-8af8-f0bbef87732b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:55.750205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74dccc51-7f38-423c-8af8-f0bbef87732b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:55.896695 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-74dccc51-7f38-423c-8af8-f0bbef87732b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:55.902606 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-74dccc51-7f38-423c-8af8-f0bbef87732b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1366 microversion: 2.1 time: 0.166993 Aug 10 17:18:55.903248 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 330/655] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:55 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:56.137756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b3b7ad58-4ba4-489f-809e-eb3c8643c3d9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:56.138295 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b3b7ad58-4ba4-489f-809e-eb3c8643c3d9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:56.144239 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3b7ad58-4ba4-489f-809e-eb3c8643c3d9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:56.144772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3b7ad58-4ba4-489f-809e-eb3c8643c3d9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:56.146200 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3b7ad58-4ba4-489f-809e-eb3c8643c3d9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:56.147245 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3b7ad58-4ba4-489f-809e-eb3c8643c3d9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:56.147982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3b7ad58-4ba4-489f-809e-eb3c8643c3d9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:56.148413 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3b7ad58-4ba4-489f-809e-eb3c8643c3d9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:56.251289 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b05620df-e9af-4fe5-95f6-c9e43988a78f tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:56.252124 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b05620df-e9af-4fe5-95f6-c9e43988a78f tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:56.259193 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b05620df-e9af-4fe5-95f6-c9e43988a78f tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:56.259949 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b05620df-e9af-4fe5-95f6-c9e43988a78f tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:56.260385 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b05620df-e9af-4fe5-95f6-c9e43988a78f tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:56.261300 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b05620df-e9af-4fe5-95f6-c9e43988a78f tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:56.261756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b05620df-e9af-4fe5-95f6-c9e43988a78f tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:56.262180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b05620df-e9af-4fe5-95f6-c9e43988a78f tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:56.296099 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b3b7ad58-4ba4-489f-809e-eb3c8643c3d9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:56.306798 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b3b7ad58-4ba4-489f-809e-eb3c8643c3d9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.172550 Aug 10 17:18:56.319728 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 326/656] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:56 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:56.331529 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b05620df-e9af-4fe5-95f6-c9e43988a78f tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:56.350503 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b05620df-e9af-4fe5-95f6-c9e43988a78f tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1284 microversion: 2.1 time: 0.092976 Aug 10 17:18:56.352567 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 331/657] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:56 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:18:56.925749 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-632809b4-f3f6-4085-8ff6-57ec06c7638b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:56.926380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-632809b4-f3f6-4085-8ff6-57ec06c7638b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:56.932634 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-632809b4-f3f6-4085-8ff6-57ec06c7638b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:56.933201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-632809b4-f3f6-4085-8ff6-57ec06c7638b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:56.933645 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-632809b4-f3f6-4085-8ff6-57ec06c7638b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:56.934410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-632809b4-f3f6-4085-8ff6-57ec06c7638b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:56.934849 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-632809b4-f3f6-4085-8ff6-57ec06c7638b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:56.935279 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-632809b4-f3f6-4085-8ff6-57ec06c7638b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:57.095131 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-632809b4-f3f6-4085-8ff6-57ec06c7638b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:57.102184 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-632809b4-f3f6-4085-8ff6-57ec06c7638b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1366 microversion: 2.1 time: 0.180760 Aug 10 17:18:57.103341 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 327/658] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:56 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:57.329902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c6a5bf73-5630-4861-86ee-6035d63d40c2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:57.331020 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c6a5bf73-5630-4861-86ee-6035d63d40c2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:57.339215 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6a5bf73-5630-4861-86ee-6035d63d40c2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:57.340417 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6a5bf73-5630-4861-86ee-6035d63d40c2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:57.341098 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6a5bf73-5630-4861-86ee-6035d63d40c2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:57.341703 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6a5bf73-5630-4861-86ee-6035d63d40c2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:57.342257 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6a5bf73-5630-4861-86ee-6035d63d40c2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:57.342961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6a5bf73-5630-4861-86ee-6035d63d40c2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:57.372840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ab8c4b27-baea-4708-9776-6d15c2a197cd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:57.374127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ab8c4b27-baea-4708-9776-6d15c2a197cd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:57.381209 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab8c4b27-baea-4708-9776-6d15c2a197cd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:57.387007 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab8c4b27-baea-4708-9776-6d15c2a197cd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:57.387007 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab8c4b27-baea-4708-9776-6d15c2a197cd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:57.387007 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab8c4b27-baea-4708-9776-6d15c2a197cd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:57.387007 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab8c4b27-baea-4708-9776-6d15c2a197cd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:57.387420 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab8c4b27-baea-4708-9776-6d15c2a197cd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:57.545964 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c6a5bf73-5630-4861-86ee-6035d63d40c2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:57.555538 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c6a5bf73-5630-4861-86ee-6035d63d40c2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.230150 Aug 10 17:18:57.556539 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 332/659] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:57 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:57.579452 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ab8c4b27-baea-4708-9776-6d15c2a197cd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:57.587671 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ab8c4b27-baea-4708-9776-6d15c2a197cd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1314 microversion: 2.1 time: 0.220483 Aug 10 17:18:57.590069 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 328/660] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:57 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:18:58.038626 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-e18cf38d-6d2e-443b-a3de-f4ecc9967397 req-578cf31d-9605-4982-bae6-9581d6084cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66eaff4b-86d0-4d8c-94d9-16ade66ef315", "tag": "c2c3c673-aaaa-4c62-aab9-081b1255a165"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:18:58.048523 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e18cf38d-6d2e-443b-a3de-f4ecc9967397 req-578cf31d-9605-4982-bae6-9581d6084cc8 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:58.048921 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e18cf38d-6d2e-443b-a3de-f4ecc9967397 req-578cf31d-9605-4982-bae6-9581d6084cc8 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:58.049361 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e18cf38d-6d2e-443b-a3de-f4ecc9967397 req-578cf31d-9605-4982-bae6-9581d6084cc8 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:58.061092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-e18cf38d-6d2e-443b-a3de-f4ecc9967397 req-578cf31d-9605-4982-bae6-9581d6084cc8 service nova] Creating event network-changed:c2c3c673-aaaa-4c62-aab9-081b1255a165 for instance 66eaff4b-86d0-4d8c-94d9-16ade66ef315 on hv-cinder-85272 Aug 10 17:18:58.066233 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-e18cf38d-6d2e-443b-a3de-f4ecc9967397 req-578cf31d-9605-4982-bae6-9581d6084cc8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031337 Aug 10 17:18:58.070762 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 333/661] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:18:58.124191 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-689f47cf-4320-4e61-b9cb-b6291e6a51d5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:58.125081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-689f47cf-4320-4e61-b9cb-b6291e6a51d5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:58.133150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-689f47cf-4320-4e61-b9cb-b6291e6a51d5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:58.133645 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-689f47cf-4320-4e61-b9cb-b6291e6a51d5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:58.134083 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-689f47cf-4320-4e61-b9cb-b6291e6a51d5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:58.135102 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-689f47cf-4320-4e61-b9cb-b6291e6a51d5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:58.136897 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-689f47cf-4320-4e61-b9cb-b6291e6a51d5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:58.137380 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-689f47cf-4320-4e61-b9cb-b6291e6a51d5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:58.295726 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-689f47cf-4320-4e61-b9cb-b6291e6a51d5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:58.300096 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:18:58.306853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-689f47cf-4320-4e61-b9cb-b6291e6a51d5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1366 microversion: 2.1 time: 0.186589 Aug 10 17:18:58.311261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 329/662] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:58 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:58.578691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-532ebc5b-c144-4530-ab25-50b274423387 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:58.579402 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-532ebc5b-c144-4530-ab25-50b274423387 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:58.586720 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-532ebc5b-c144-4530-ab25-50b274423387 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:58.587221 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-532ebc5b-c144-4530-ab25-50b274423387 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:58.587664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-532ebc5b-c144-4530-ab25-50b274423387 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:58.588376 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-532ebc5b-c144-4530-ab25-50b274423387 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:58.588834 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-532ebc5b-c144-4530-ab25-50b274423387 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:58.589266 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-532ebc5b-c144-4530-ab25-50b274423387 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:58.609599 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7309dfee-0cd4-4329-9a16-9d389dc90d6b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:58.610977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7309dfee-0cd4-4329-9a16-9d389dc90d6b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:58.622828 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7309dfee-0cd4-4329-9a16-9d389dc90d6b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:58.623560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7309dfee-0cd4-4329-9a16-9d389dc90d6b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:58.624689 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7309dfee-0cd4-4329-9a16-9d389dc90d6b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:58.624689 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7309dfee-0cd4-4329-9a16-9d389dc90d6b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:58.625159 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7309dfee-0cd4-4329-9a16-9d389dc90d6b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:58.625761 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7309dfee-0cd4-4329-9a16-9d389dc90d6b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:58.810618 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-532ebc5b-c144-4530-ab25-50b274423387 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:58.820300 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-532ebc5b-c144-4530-ab25-50b274423387 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.246324 Aug 10 17:18:58.821003 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7309dfee-0cd4-4329-9a16-9d389dc90d6b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:58.834096 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 334/663] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:58 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:58.839737 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7309dfee-0cd4-4329-9a16-9d389dc90d6b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1314 microversion: 2.1 time: 0.234262 Aug 10 17:18:58.840319 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 330/664] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:58 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:59.111703 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-e39c681b-64c6-4996-ac59-83084bf59f0b req-e99cc732-cdc0-4e78-9152-2dbda23ad9cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e755ffcc-1904-43e4-b6ab-5132e4e7294e", "name": "network-vif-plugged", "status": "completed", "tag": "c4c22bfb-50a9-4cd8-b161-a090e4995343"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:18:59.122174 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e39c681b-64c6-4996-ac59-83084bf59f0b req-e99cc732-cdc0-4e78-9152-2dbda23ad9cc service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:59.122694 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e39c681b-64c6-4996-ac59-83084bf59f0b req-e99cc732-cdc0-4e78-9152-2dbda23ad9cc service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:59.123137 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e39c681b-64c6-4996-ac59-83084bf59f0b req-e99cc732-cdc0-4e78-9152-2dbda23ad9cc service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:59.134751 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-e39c681b-64c6-4996-ac59-83084bf59f0b req-e99cc732-cdc0-4e78-9152-2dbda23ad9cc service nova] Creating event network-vif-plugged:c4c22bfb-50a9-4cd8-b161-a090e4995343 for instance e755ffcc-1904-43e4-b6ab-5132e4e7294e on hv-cinder-85272 Aug 10 17:18:59.139934 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-e39c681b-64c6-4996-ac59-83084bf59f0b req-e99cc732-cdc0-4e78-9152-2dbda23ad9cc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031875 Aug 10 17:18:59.141193 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 335/665] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:18:59.328741 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8472272d-9ee0-4c96-982c-fc13d8047f81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:59.329401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8472272d-9ee0-4c96-982c-fc13d8047f81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:59.336174 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8472272d-9ee0-4c96-982c-fc13d8047f81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:59.336664 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8472272d-9ee0-4c96-982c-fc13d8047f81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:59.337102 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8472272d-9ee0-4c96-982c-fc13d8047f81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:59.337803 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8472272d-9ee0-4c96-982c-fc13d8047f81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:59.338390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8472272d-9ee0-4c96-982c-fc13d8047f81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:59.338819 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8472272d-9ee0-4c96-982c-fc13d8047f81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:59.474975 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8472272d-9ee0-4c96-982c-fc13d8047f81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:18:59.482513 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8472272d-9ee0-4c96-982c-fc13d8047f81 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1366 microversion: 2.1 time: 0.157947 Aug 10 17:18:59.483084 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 331/666] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:59 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:18:59.844205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9531e147-a482-4559-83eb-b3b7f92e1da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:59.844908 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9531e147-a482-4559-83eb-b3b7f92e1da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:59.851708 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9531e147-a482-4559-83eb-b3b7f92e1da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:59.852194 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9531e147-a482-4559-83eb-b3b7f92e1da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:59.852637 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9531e147-a482-4559-83eb-b3b7f92e1da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:59.853339 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9531e147-a482-4559-83eb-b3b7f92e1da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:59.853815 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9531e147-a482-4559-83eb-b3b7f92e1da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:59.854239 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9531e147-a482-4559-83eb-b3b7f92e1da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:59.860777 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7f052eb6-ae51-4fac-903e-cf7bc7d539be tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:18:59.861553 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7f052eb6-ae51-4fac-903e-cf7bc7d539be tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:18:59.869492 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f052eb6-ae51-4fac-903e-cf7bc7d539be tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:59.869999 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f052eb6-ae51-4fac-903e-cf7bc7d539be tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:59.870436 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f052eb6-ae51-4fac-903e-cf7bc7d539be tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:18:59.871195 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f052eb6-ae51-4fac-903e-cf7bc7d539be tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:18:59.871647 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f052eb6-ae51-4fac-903e-cf7bc7d539be tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:18:59.872062 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f052eb6-ae51-4fac-903e-cf7bc7d539be tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:00.064637 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9531e147-a482-4559-83eb-b3b7f92e1da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:00.068315 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7f052eb6-ae51-4fac-903e-cf7bc7d539be tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:00.074655 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9531e147-a482-4559-83eb-b3b7f92e1da1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.235209 Aug 10 17:19:00.075239 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 336/667] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:59 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:00.076055 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7f052eb6-ae51-4fac-903e-cf7bc7d539be tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1314 microversion: 2.1 time: 0.219394 Aug 10 17:19:00.076572 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 332/668] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:18:59 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:19:00.504022 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-01ee3411-3fa4-4a7a-b4f6-28f0f8ffb4e9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:00.504684 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-01ee3411-3fa4-4a7a-b4f6-28f0f8ffb4e9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:00.511217 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01ee3411-3fa4-4a7a-b4f6-28f0f8ffb4e9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:00.511705 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01ee3411-3fa4-4a7a-b4f6-28f0f8ffb4e9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:00.512143 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01ee3411-3fa4-4a7a-b4f6-28f0f8ffb4e9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:00.512849 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01ee3411-3fa4-4a7a-b4f6-28f0f8ffb4e9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:00.513307 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01ee3411-3fa4-4a7a-b4f6-28f0f8ffb4e9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:00.513736 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01ee3411-3fa4-4a7a-b4f6-28f0f8ffb4e9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:00.655147 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-01ee3411-3fa4-4a7a-b4f6-28f0f8ffb4e9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:00.663693 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-01ee3411-3fa4-4a7a-b4f6-28f0f8ffb4e9 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1366 microversion: 2.1 time: 0.163441 Aug 10 17:19:00.664272 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 337/669] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:00 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:01.098502 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ac8c7e32-52b5-4524-92bf-c7f958c2b713 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:01.099765 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ac8c7e32-52b5-4524-92bf-c7f958c2b713 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:01.099931 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-89ecb1ed-6184-43cf-8aae-bebb5efd1b31 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:01.100505 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-89ecb1ed-6184-43cf-8aae-bebb5efd1b31 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:01.106508 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac8c7e32-52b5-4524-92bf-c7f958c2b713 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:01.107069 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac8c7e32-52b5-4524-92bf-c7f958c2b713 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:01.107197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-89ecb1ed-6184-43cf-8aae-bebb5efd1b31 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:01.107452 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac8c7e32-52b5-4524-92bf-c7f958c2b713 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:01.107603 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-89ecb1ed-6184-43cf-8aae-bebb5efd1b31 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:01.107984 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-89ecb1ed-6184-43cf-8aae-bebb5efd1b31 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:01.108331 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac8c7e32-52b5-4524-92bf-c7f958c2b713 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:01.108630 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac8c7e32-52b5-4524-92bf-c7f958c2b713 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:01.108868 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-89ecb1ed-6184-43cf-8aae-bebb5efd1b31 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:01.109060 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac8c7e32-52b5-4524-92bf-c7f958c2b713 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:01.109195 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-89ecb1ed-6184-43cf-8aae-bebb5efd1b31 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:01.109551 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-89ecb1ed-6184-43cf-8aae-bebb5efd1b31 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:01.317447 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-89ecb1ed-6184-43cf-8aae-bebb5efd1b31 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:01.324969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ac8c7e32-52b5-4524-92bf-c7f958c2b713 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:01.325779 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-89ecb1ed-6184-43cf-8aae-bebb5efd1b31 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.232005 Aug 10 17:19:01.326641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 333/670] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:01 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:01.334013 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ac8c7e32-52b5-4524-92bf-c7f958c2b713 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1314 microversion: 2.1 time: 0.239457 Aug 10 17:19:01.334780 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 338/671] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:01 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:19:01.685061 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9dce0987-d6b5-4fb3-b777-183a2ba21266 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:01.685776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9dce0987-d6b5-4fb3-b777-183a2ba21266 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:01.691889 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9dce0987-d6b5-4fb3-b777-183a2ba21266 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:01.693060 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9dce0987-d6b5-4fb3-b777-183a2ba21266 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:01.693697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9dce0987-d6b5-4fb3-b777-183a2ba21266 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:01.694451 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9dce0987-d6b5-4fb3-b777-183a2ba21266 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:01.694919 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9dce0987-d6b5-4fb3-b777-183a2ba21266 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:01.695345 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9dce0987-d6b5-4fb3-b777-183a2ba21266 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:01.834810 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9dce0987-d6b5-4fb3-b777-183a2ba21266 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:01.842757 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9dce0987-d6b5-4fb3-b777-183a2ba21266 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1366 microversion: 2.1 time: 0.161681 Aug 10 17:19:01.843264 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 334/672] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:01 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:02.348100 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e60f7341-37e7-48da-8a95-667d08ce6724 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:02.349308 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e60f7341-37e7-48da-8a95-667d08ce6724 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:02.351265 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=4 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:02.351946 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=12 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:02.353070 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:02.355520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e9c20546-1bc2-4fdd-8e24-6c6a1af699a2 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:02.356227 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e9c20546-1bc2-4fdd-8e24-6c6a1af699a2 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:02.366672 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e60f7341-37e7-48da-8a95-667d08ce6724 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:02.366672 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e60f7341-37e7-48da-8a95-667d08ce6724 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:02.366672 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e60f7341-37e7-48da-8a95-667d08ce6724 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:02.366672 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e60f7341-37e7-48da-8a95-667d08ce6724 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:02.367110 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e60f7341-37e7-48da-8a95-667d08ce6724 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:02.367110 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e60f7341-37e7-48da-8a95-667d08ce6724 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:02.367278 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e9c20546-1bc2-4fdd-8e24-6c6a1af699a2 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:02.367278 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e9c20546-1bc2-4fdd-8e24-6c6a1af699a2 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:02.367278 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e9c20546-1bc2-4fdd-8e24-6c6a1af699a2 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:02.367278 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e9c20546-1bc2-4fdd-8e24-6c6a1af699a2 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:02.367614 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e9c20546-1bc2-4fdd-8e24-6c6a1af699a2 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:02.367614 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e9c20546-1bc2-4fdd-8e24-6c6a1af699a2 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:02.564091 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e60f7341-37e7-48da-8a95-667d08ce6724 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:02.573680 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e60f7341-37e7-48da-8a95-667d08ce6724 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.229276 Aug 10 17:19:02.574109 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 339/673] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:02 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:02.576077 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e9c20546-1bc2-4fdd-8e24-6c6a1af699a2 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:02.585347 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e9c20546-1bc2-4fdd-8e24-6c6a1af699a2 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1314 microversion: 2.1 time: 0.233683 Aug 10 17:19:02.585924 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 335/674] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:02 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:19:02.867463 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b0d7a03c-254d-4e61-be97-b4025a9f7c9a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:02.868068 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b0d7a03c-254d-4e61-be97-b4025a9f7c9a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:02.874854 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0d7a03c-254d-4e61-be97-b4025a9f7c9a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:02.875355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0d7a03c-254d-4e61-be97-b4025a9f7c9a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:02.875867 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0d7a03c-254d-4e61-be97-b4025a9f7c9a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:02.876575 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0d7a03c-254d-4e61-be97-b4025a9f7c9a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:02.877035 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0d7a03c-254d-4e61-be97-b4025a9f7c9a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:02.877465 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0d7a03c-254d-4e61-be97-b4025a9f7c9a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:03.130067 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-5ab0623b-f67a-4928-b9c2-5a24108c1673 req-53e147dd-d60a-4120-a473-a20c243b5286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66eaff4b-86d0-4d8c-94d9-16ade66ef315", "name": "network-vif-plugged", "status": "completed", "tag": "c2c3c673-aaaa-4c62-aab9-081b1255a165"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:03.142189 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=12 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:03.148339 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-5ab0623b-f67a-4928-b9c2-5a24108c1673 req-53e147dd-d60a-4120-a473-a20c243b5286 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:03.148820 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-5ab0623b-f67a-4928-b9c2-5a24108c1673 req-53e147dd-d60a-4120-a473-a20c243b5286 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:03.149306 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-5ab0623b-f67a-4928-b9c2-5a24108c1673 req-53e147dd-d60a-4120-a473-a20c243b5286 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:03.163415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-5ab0623b-f67a-4928-b9c2-5a24108c1673 req-53e147dd-d60a-4120-a473-a20c243b5286 service nova] Creating event network-vif-plugged:c2c3c673-aaaa-4c62-aab9-081b1255a165 for instance 66eaff4b-86d0-4d8c-94d9-16ade66ef315 on hv-cinder-85272 Aug 10 17:19:03.168490 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-5ab0623b-f67a-4928-b9c2-5a24108c1673 req-53e147dd-d60a-4120-a473-a20c243b5286 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042207 Aug 10 17:19:03.169297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 336/675] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:19:03.190693 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b0d7a03c-254d-4e61-be97-b4025a9f7c9a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:03.198245 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b0d7a03c-254d-4e61-be97-b4025a9f7c9a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1366 microversion: 2.1 time: 0.337222 Aug 10 17:19:03.198831 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 340/676] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:02 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:03.597645 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6c7016a4-d20b-427a-9492-7998f8093dc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:03.598426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6c7016a4-d20b-427a-9492-7998f8093dc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:03.605536 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-58da316f-6ae6-4d82-ad5f-7a5bfd085cf8 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:03.606305 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-58da316f-6ae6-4d82-ad5f-7a5bfd085cf8 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:03.606459 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c7016a4-d20b-427a-9492-7998f8093dc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:03.607078 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c7016a4-d20b-427a-9492-7998f8093dc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:03.612755 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c7016a4-d20b-427a-9492-7998f8093dc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:03.612755 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c7016a4-d20b-427a-9492-7998f8093dc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:03.612755 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c7016a4-d20b-427a-9492-7998f8093dc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:03.612755 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c7016a4-d20b-427a-9492-7998f8093dc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:03.615228 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58da316f-6ae6-4d82-ad5f-7a5bfd085cf8 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:03.615828 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58da316f-6ae6-4d82-ad5f-7a5bfd085cf8 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:03.616383 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58da316f-6ae6-4d82-ad5f-7a5bfd085cf8 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:03.617212 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58da316f-6ae6-4d82-ad5f-7a5bfd085cf8 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:03.620295 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58da316f-6ae6-4d82-ad5f-7a5bfd085cf8 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:03.620888 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58da316f-6ae6-4d82-ad5f-7a5bfd085cf8 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:03.816439 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6c7016a4-d20b-427a-9492-7998f8093dc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:03.821493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-58da316f-6ae6-4d82-ad5f-7a5bfd085cf8 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:03.825351 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6c7016a4-d20b-427a-9492-7998f8093dc4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.232683 Aug 10 17:19:03.825927 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 337/677] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:03 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:03.829365 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-58da316f-6ae6-4d82-ad5f-7a5bfd085cf8 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1314 microversion: 2.1 time: 0.227784 Aug 10 17:19:03.829943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 341/678] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:03 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:19:04.219624 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9816f087-ee1b-4124-aef6-ce6ab9b2a533 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:04.220279 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9816f087-ee1b-4124-aef6-ce6ab9b2a533 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:04.226887 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9816f087-ee1b-4124-aef6-ce6ab9b2a533 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:04.227378 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9816f087-ee1b-4124-aef6-ce6ab9b2a533 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:04.227819 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9816f087-ee1b-4124-aef6-ce6ab9b2a533 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:04.228523 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9816f087-ee1b-4124-aef6-ce6ab9b2a533 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:04.228982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9816f087-ee1b-4124-aef6-ce6ab9b2a533 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:04.229411 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9816f087-ee1b-4124-aef6-ce6ab9b2a533 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:04.368947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9816f087-ee1b-4124-aef6-ce6ab9b2a533 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:04.376683 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9816f087-ee1b-4124-aef6-ce6ab9b2a533 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1555 microversion: 2.1 time: 0.160970 Aug 10 17:19:04.377257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 338/679] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:04 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:04.397828 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5d17cf34-b473-4e99-af0f-e7965311bf4c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:04.398320 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5d17cf34-b473-4e99-af0f-e7965311bf4c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:04.404533 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d17cf34-b473-4e99-af0f-e7965311bf4c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:04.405015 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d17cf34-b473-4e99-af0f-e7965311bf4c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:04.405475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d17cf34-b473-4e99-af0f-e7965311bf4c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:04.406228 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d17cf34-b473-4e99-af0f-e7965311bf4c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:04.406724 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d17cf34-b473-4e99-af0f-e7965311bf4c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:04.407150 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d17cf34-b473-4e99-af0f-e7965311bf4c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:04.489502 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5d17cf34-b473-4e99-af0f-e7965311bf4c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096004 Aug 10 17:19:04.490096 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 342/680] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 17:19:04 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:19:04.846617 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0d79941e-b569-42ad-9e8b-6c17ebe6c0fa tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:04.847246 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0d79941e-b569-42ad-9e8b-6c17ebe6c0fa tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:04.850426 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-714f8d99-9f8b-44bd-982f-0b8f97870307 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:04.852097 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-714f8d99-9f8b-44bd-982f-0b8f97870307 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:04.854263 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d79941e-b569-42ad-9e8b-6c17ebe6c0fa tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:04.854809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d79941e-b569-42ad-9e8b-6c17ebe6c0fa tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:04.860425 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d79941e-b569-42ad-9e8b-6c17ebe6c0fa tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:04.860425 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d79941e-b569-42ad-9e8b-6c17ebe6c0fa tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:04.860425 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d79941e-b569-42ad-9e8b-6c17ebe6c0fa tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:04.860425 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d79941e-b569-42ad-9e8b-6c17ebe6c0fa tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:04.860868 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-714f8d99-9f8b-44bd-982f-0b8f97870307 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:04.860868 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-714f8d99-9f8b-44bd-982f-0b8f97870307 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:04.860868 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-714f8d99-9f8b-44bd-982f-0b8f97870307 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:04.860868 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-714f8d99-9f8b-44bd-982f-0b8f97870307 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:04.861624 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-714f8d99-9f8b-44bd-982f-0b8f97870307 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:04.862152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-714f8d99-9f8b-44bd-982f-0b8f97870307 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:05.062143 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-714f8d99-9f8b-44bd-982f-0b8f97870307 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:05.072597 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-714f8d99-9f8b-44bd-982f-0b8f97870307 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1314 microversion: 2.1 time: 0.227439 Aug 10 17:19:05.073435 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 343/681] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:04 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:19:05.127512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0d79941e-b569-42ad-9e8b-6c17ebe6c0fa tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:05.136750 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0d79941e-b569-42ad-9e8b-6c17ebe6c0fa tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1734 microversion: 2.1 time: 0.294037 Aug 10 17:19:05.137332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 339/682] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:04 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1734 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:05.683740 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-f844487d-8507-4dda-8cde-4a077335d10a req-e5932a9a-8a9a-4597-a674-5cb14f3c8e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e755ffcc-1904-43e4-b6ab-5132e4e7294e", "tag": "c4c22bfb-50a9-4cd8-b161-a090e4995343"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:05.694167 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f844487d-8507-4dda-8cde-4a077335d10a req-e5932a9a-8a9a-4597-a674-5cb14f3c8e6b service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:05.694680 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f844487d-8507-4dda-8cde-4a077335d10a req-e5932a9a-8a9a-4597-a674-5cb14f3c8e6b service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:05.695108 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f844487d-8507-4dda-8cde-4a077335d10a req-e5932a9a-8a9a-4597-a674-5cb14f3c8e6b service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:05.706295 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-f844487d-8507-4dda-8cde-4a077335d10a req-e5932a9a-8a9a-4597-a674-5cb14f3c8e6b service nova] Creating event network-changed:c4c22bfb-50a9-4cd8-b161-a090e4995343 for instance e755ffcc-1904-43e4-b6ab-5132e4e7294e on hv-cinder-85272 Aug 10 17:19:05.712119 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-f844487d-8507-4dda-8cde-4a077335d10a req-e5932a9a-8a9a-4597-a674-5cb14f3c8e6b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031946 Aug 10 17:19:05.712771 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 344/683] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:19:06.095554 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-86cf4279-e2e1-47ce-9d81-797268efbbec tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:06.096169 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-86cf4279-e2e1-47ce-9d81-797268efbbec tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:06.103471 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-86cf4279-e2e1-47ce-9d81-797268efbbec tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:06.103957 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-86cf4279-e2e1-47ce-9d81-797268efbbec tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:06.104390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-86cf4279-e2e1-47ce-9d81-797268efbbec tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:06.105084 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-86cf4279-e2e1-47ce-9d81-797268efbbec tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:06.105532 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-86cf4279-e2e1-47ce-9d81-797268efbbec tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:06.105949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-86cf4279-e2e1-47ce-9d81-797268efbbec tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:06.158637 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0ce85f20-7c45-46d2-9051-c5d0435f081b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:06.159571 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0ce85f20-7c45-46d2-9051-c5d0435f081b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:06.167900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ce85f20-7c45-46d2-9051-c5d0435f081b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:06.168507 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ce85f20-7c45-46d2-9051-c5d0435f081b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:06.169204 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ce85f20-7c45-46d2-9051-c5d0435f081b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:06.170311 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ce85f20-7c45-46d2-9051-c5d0435f081b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:06.170892 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ce85f20-7c45-46d2-9051-c5d0435f081b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:06.171407 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ce85f20-7c45-46d2-9051-c5d0435f081b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:06.311627 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-86cf4279-e2e1-47ce-9d81-797268efbbec tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:06.340884 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-86cf4279-e2e1-47ce-9d81-797268efbbec tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1314 microversion: 2.1 time: 0.248912 Aug 10 17:19:06.350728 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 340/684] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:06 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:06.393690 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0ce85f20-7c45-46d2-9051-c5d0435f081b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:06.403218 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0ce85f20-7c45-46d2-9051-c5d0435f081b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1714 microversion: 2.1 time: 0.249395 Aug 10 17:19:06.404082 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 345/685] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:06 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1714 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:19:06.534715 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-14621aa8-fb1f-48c6-9575-440d29e1dec9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:06.535140 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-14621aa8-fb1f-48c6-9575-440d29e1dec9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:06.541840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-14621aa8-fb1f-48c6-9575-440d29e1dec9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:06.542337 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-14621aa8-fb1f-48c6-9575-440d29e1dec9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:06.542818 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-14621aa8-fb1f-48c6-9575-440d29e1dec9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:06.543518 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-14621aa8-fb1f-48c6-9575-440d29e1dec9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:06.543973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-14621aa8-fb1f-48c6-9575-440d29e1dec9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:06.544396 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-14621aa8-fb1f-48c6-9575-440d29e1dec9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:06.634289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-14621aa8-fb1f-48c6-9575-440d29e1dec9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] HTTP exception thrown: Cannot 'detach_volume' instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 while it is in vm_state rescued Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-14621aa8-fb1f-48c6-9575-440d29e1dec9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Request method failure captured: Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments/3210059d-735c-485a-a95d-34138d4f7c6f HTTP/1.1 Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-dswVGFX6YnssvSdTDTGYKFuPUcQkPiuoht6xjK41FLbLRERzNejhLlYaJj4B97fXmairLkYtq3qAN844xnnJD_nNs69F67xjXDl2MQv0g2LKJF8vMzfdI49Cx11gpD5xAT_u8QAAlFxfzo1W-6WvyoQXKrMEdXy7XIMxCTOEUbAnc Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: 2eb3ea42180f4a0ca5ca3c90962fb301 Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:19:06.636332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:19:06.637732 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2eb3ea42180f4a0ca5ca3c90962fb301", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2eb3ea42180f4a0ca5ca3c90962fb301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2eb3ea42180f4a0ca5ca3c90962fb301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2eb3ea42180f4a0ca5ca3c90962fb301"}]}] Aug 10 17:19:06.637732 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:19:06.637732 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 2eb3ea42180f4a0ca5ca3c90962fb301 Aug 10 17:19:06.637732 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:19:06.637732 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-ServerRescueNegativeTestJSON-1974687270-project Aug 10 17:19:06.637732 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:19:06.637732 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:19:06.637732 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 7d2a65984c4f42fbb18977c7345c42ce Aug 10 17:19:06.637732 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1974687270-project Aug 10 17:19:06.637732 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:19:06.637732 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Cannot 'detach_volume' instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 while it is in vm_state rescued Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'server_id': '60a02347-095c-4aa2-92b0-5bcdf5fce2a9', 'id': '3210059d-735c-485a-a95d-34138d4f7c6f'} Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:19:06.638622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 while it is in vm_state rescued Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 while it is in vm_state rescued Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:19:06.639896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-14621aa8-fb1f-48c6-9575-440d29e1dec9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Returning 409 to user: Cannot 'detach_volume' instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 while it is in vm_state rescued {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:19:06.640920 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-14621aa8-fb1f-48c6-9575-440d29e1dec9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "DELETE /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments/3210059d-735c-485a-a95d-34138d4f7c6f" status: 409 len: 152 microversion: 2.1 time: 0.107334 Aug 10 17:19:06.640920 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 341/686] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 17:19:06 2022] DELETE /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments/3210059d-735c-485a-a95d-34138d4f7c6f => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 17:19:06.647735 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b4d2b993-fcf2-438a-b9e1-032c0e563ab0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:06.648276 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b4d2b993-fcf2-438a-b9e1-032c0e563ab0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:06.654914 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4d2b993-fcf2-438a-b9e1-032c0e563ab0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:06.655029 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4d2b993-fcf2-438a-b9e1-032c0e563ab0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:06.655376 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4d2b993-fcf2-438a-b9e1-032c0e563ab0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:06.656087 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4d2b993-fcf2-438a-b9e1-032c0e563ab0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:06.656620 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4d2b993-fcf2-438a-b9e1-032c0e563ab0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:06.657017 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4d2b993-fcf2-438a-b9e1-032c0e563ab0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:06.800860 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:06.972378 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b4d2b993-fcf2-438a-b9e1-032c0e563ab0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "POST /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/action" status: 202 len: 0 microversion: 2.1 time: 0.328950 Aug 10 17:19:06.973035 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 346/687] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:19:06 2022] POST /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:19:06.982701 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ba2351b5-3a64-41e8-bdde-b51211cceb88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:06.983482 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ba2351b5-3a64-41e8-bdde-b51211cceb88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:06.990008 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba2351b5-3a64-41e8-bdde-b51211cceb88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:06.990608 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba2351b5-3a64-41e8-bdde-b51211cceb88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:06.991070 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba2351b5-3a64-41e8-bdde-b51211cceb88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:06.991763 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba2351b5-3a64-41e8-bdde-b51211cceb88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:06.992222 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba2351b5-3a64-41e8-bdde-b51211cceb88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:06.992650 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba2351b5-3a64-41e8-bdde-b51211cceb88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:07.154864 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ba2351b5-3a64-41e8-bdde-b51211cceb88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:07.163950 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ba2351b5-3a64-41e8-bdde-b51211cceb88 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1722 microversion: 2.1 time: 0.185394 Aug 10 17:19:07.164533 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 342/688] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:06 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:07.372612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f7815e15-d264-4308-87e3-96b5ff6355d4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:07.373313 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f7815e15-d264-4308-87e3-96b5ff6355d4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:07.380492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7815e15-d264-4308-87e3-96b5ff6355d4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:07.380994 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7815e15-d264-4308-87e3-96b5ff6355d4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:07.381439 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7815e15-d264-4308-87e3-96b5ff6355d4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:07.382152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7815e15-d264-4308-87e3-96b5ff6355d4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:07.382645 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7815e15-d264-4308-87e3-96b5ff6355d4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:07.383079 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7815e15-d264-4308-87e3-96b5ff6355d4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:07.533005 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f7815e15-d264-4308-87e3-96b5ff6355d4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:07.541304 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f7815e15-d264-4308-87e3-96b5ff6355d4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1464 microversion: 2.1 time: 0.173659 Aug 10 17:19:07.541887 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 347/689] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:07 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1464 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:07.587200 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-46c08d18-50f6-4c29-a1d7-54c3d4d03cdd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:07.587780 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-46c08d18-50f6-4c29-a1d7-54c3d4d03cdd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:07.593871 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-46c08d18-50f6-4c29-a1d7-54c3d4d03cdd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:07.594489 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-46c08d18-50f6-4c29-a1d7-54c3d4d03cdd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:07.595015 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-46c08d18-50f6-4c29-a1d7-54c3d4d03cdd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:07.595784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-46c08d18-50f6-4c29-a1d7-54c3d4d03cdd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:07.596314 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-46c08d18-50f6-4c29-a1d7-54c3d4d03cdd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:07.596811 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-46c08d18-50f6-4c29-a1d7-54c3d4d03cdd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:07.628076 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-46c08d18-50f6-4c29-a1d7-54c3d4d03cdd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:19:07.958230 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-46c08d18-50f6-4c29-a1d7-54c3d4d03cdd tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "DELETE /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 204 len: 0 microversion: 2.1 time: 0.375058 Aug 10 17:19:07.958906 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 343/690] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:19:07 2022] DELETE /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:19:07.967234 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ba34164b-e7a8-4959-88a9-8660c6ec77e4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:07.967858 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ba34164b-e7a8-4959-88a9-8660c6ec77e4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:07.973823 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba34164b-e7a8-4959-88a9-8660c6ec77e4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:07.974317 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba34164b-e7a8-4959-88a9-8660c6ec77e4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:07.974790 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba34164b-e7a8-4959-88a9-8660c6ec77e4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:07.975492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba34164b-e7a8-4959-88a9-8660c6ec77e4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:07.975962 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba34164b-e7a8-4959-88a9-8660c6ec77e4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:07.976387 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba34164b-e7a8-4959-88a9-8660c6ec77e4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:08.109784 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ba34164b-e7a8-4959-88a9-8660c6ec77e4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:08.118460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ba34164b-e7a8-4959-88a9-8660c6ec77e4 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1470 microversion: 2.1 time: 0.154965 Aug 10 17:19:08.119038 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 348/691] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:07 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:08.187130 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-33fead28-15a8-4f95-b1df-e0f6b18e1a71 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:08.187837 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-33fead28-15a8-4f95-b1df-e0f6b18e1a71 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:08.195041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33fead28-15a8-4f95-b1df-e0f6b18e1a71 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:08.195628 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33fead28-15a8-4f95-b1df-e0f6b18e1a71 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:08.195972 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33fead28-15a8-4f95-b1df-e0f6b18e1a71 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:08.196671 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33fead28-15a8-4f95-b1df-e0f6b18e1a71 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:08.197134 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33fead28-15a8-4f95-b1df-e0f6b18e1a71 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:08.197561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33fead28-15a8-4f95-b1df-e0f6b18e1a71 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:08.332660 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-33fead28-15a8-4f95-b1df-e0f6b18e1a71 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:08.341021 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-33fead28-15a8-4f95-b1df-e0f6b18e1a71 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1722 microversion: 2.1 time: 0.158144 Aug 10 17:19:08.341590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 344/692] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:08 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:09.140387 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-127754d8-49b6-49a3-b7f1-93f58c81210b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:09.140951 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-127754d8-49b6-49a3-b7f1-93f58c81210b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:09.148075 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-127754d8-49b6-49a3-b7f1-93f58c81210b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:09.148569 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-127754d8-49b6-49a3-b7f1-93f58c81210b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:09.149010 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-127754d8-49b6-49a3-b7f1-93f58c81210b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:09.149718 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-127754d8-49b6-49a3-b7f1-93f58c81210b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:09.150173 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-127754d8-49b6-49a3-b7f1-93f58c81210b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:09.150643 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-127754d8-49b6-49a3-b7f1-93f58c81210b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:09.285338 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-127754d8-49b6-49a3-b7f1-93f58c81210b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:09.293586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-127754d8-49b6-49a3-b7f1-93f58c81210b tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1470 microversion: 2.1 time: 0.157127 Aug 10 17:19:09.294158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 349/693] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:09 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:09.363710 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a8cec38b-aa4b-45c3-b15f-e2f11fee0710 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:09.364337 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a8cec38b-aa4b-45c3-b15f-e2f11fee0710 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:09.371664 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a8cec38b-aa4b-45c3-b15f-e2f11fee0710 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:09.372789 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a8cec38b-aa4b-45c3-b15f-e2f11fee0710 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:09.373243 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a8cec38b-aa4b-45c3-b15f-e2f11fee0710 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:09.374272 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a8cec38b-aa4b-45c3-b15f-e2f11fee0710 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:09.374750 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a8cec38b-aa4b-45c3-b15f-e2f11fee0710 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:09.375183 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a8cec38b-aa4b-45c3-b15f-e2f11fee0710 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:09.397574 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:09.522988 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a8cec38b-aa4b-45c3-b15f-e2f11fee0710 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:09.530889 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a8cec38b-aa4b-45c3-b15f-e2f11fee0710 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1722 microversion: 2.1 time: 0.171483 Aug 10 17:19:09.531451 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 345/694] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:09 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:10.376858 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c1a172dd-4029-4356-af26-e4eb148066ff tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:10.377478 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c1a172dd-4029-4356-af26-e4eb148066ff tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:10.384246 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c1a172dd-4029-4356-af26-e4eb148066ff tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:10.385004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c1a172dd-4029-4356-af26-e4eb148066ff tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:10.385436 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c1a172dd-4029-4356-af26-e4eb148066ff tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:10.386136 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c1a172dd-4029-4356-af26-e4eb148066ff tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:10.386742 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c1a172dd-4029-4356-af26-e4eb148066ff tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:10.387169 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c1a172dd-4029-4356-af26-e4eb148066ff tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:10.526720 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c1a172dd-4029-4356-af26-e4eb148066ff tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:10.534223 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c1a172dd-4029-4356-af26-e4eb148066ff tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1470 microversion: 2.1 time: 0.161480 Aug 10 17:19:10.534830 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 350/695] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:10 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:10.552566 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-677cc4fa-f05d-4e77-a535-53d7d7a1a7e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:10.553184 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-677cc4fa-f05d-4e77-a535-53d7d7a1a7e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:10.560136 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-677cc4fa-f05d-4e77-a535-53d7d7a1a7e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:10.560617 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-677cc4fa-f05d-4e77-a535-53d7d7a1a7e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:10.561050 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-677cc4fa-f05d-4e77-a535-53d7d7a1a7e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:10.561733 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-677cc4fa-f05d-4e77-a535-53d7d7a1a7e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:10.562182 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-677cc4fa-f05d-4e77-a535-53d7d7a1a7e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:10.562635 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-677cc4fa-f05d-4e77-a535-53d7d7a1a7e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:10.695495 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-677cc4fa-f05d-4e77-a535-53d7d7a1a7e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:10.703541 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-677cc4fa-f05d-4e77-a535-53d7d7a1a7e0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1722 microversion: 2.1 time: 0.154899 Aug 10 17:19:10.704125 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 346/696] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:10 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:11.556693 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-756a2a73-f069-4ac3-92c1-6b9f2b3cb708 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:11.557303 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-756a2a73-f069-4ac3-92c1-6b9f2b3cb708 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:11.563693 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-756a2a73-f069-4ac3-92c1-6b9f2b3cb708 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:11.564174 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-756a2a73-f069-4ac3-92c1-6b9f2b3cb708 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:11.564604 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-756a2a73-f069-4ac3-92c1-6b9f2b3cb708 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:11.565292 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-756a2a73-f069-4ac3-92c1-6b9f2b3cb708 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:11.565737 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-756a2a73-f069-4ac3-92c1-6b9f2b3cb708 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:11.566157 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-756a2a73-f069-4ac3-92c1-6b9f2b3cb708 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:11.716858 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-756a2a73-f069-4ac3-92c1-6b9f2b3cb708 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:11.727120 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-756a2a73-f069-4ac3-92c1-6b9f2b3cb708 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1470 microversion: 2.1 time: 0.173237 Aug 10 17:19:11.727120 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 351/697] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:11 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:11.743329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6723624d-7c3a-4aea-8f4a-44e16b4951bb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:11.744072 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6723624d-7c3a-4aea-8f4a-44e16b4951bb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:11.751384 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6723624d-7c3a-4aea-8f4a-44e16b4951bb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:11.751880 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6723624d-7c3a-4aea-8f4a-44e16b4951bb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:11.752316 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6723624d-7c3a-4aea-8f4a-44e16b4951bb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:11.753035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6723624d-7c3a-4aea-8f4a-44e16b4951bb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:11.753687 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6723624d-7c3a-4aea-8f4a-44e16b4951bb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:11.754793 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6723624d-7c3a-4aea-8f4a-44e16b4951bb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:11.902505 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6723624d-7c3a-4aea-8f4a-44e16b4951bb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:11.912009 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6723624d-7c3a-4aea-8f4a-44e16b4951bb tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1722 microversion: 2.1 time: 0.190168 Aug 10 17:19:11.913164 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 347/698] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:11 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:12.241259 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-f99c0c6e-e44a-4647-9b75-89eeb893b641 req-b6e1e41c-0311-41fe-a75c-31c77e6b435d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66eaff4b-86d0-4d8c-94d9-16ade66ef315", "name": "network-vif-deleted", "tag": "c2c3c673-aaaa-4c62-aab9-081b1255a165"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:12.250821 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f99c0c6e-e44a-4647-9b75-89eeb893b641 req-b6e1e41c-0311-41fe-a75c-31c77e6b435d service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:12.251310 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f99c0c6e-e44a-4647-9b75-89eeb893b641 req-b6e1e41c-0311-41fe-a75c-31c77e6b435d service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:12.251782 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f99c0c6e-e44a-4647-9b75-89eeb893b641 req-b6e1e41c-0311-41fe-a75c-31c77e6b435d service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:12.263642 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-f99c0c6e-e44a-4647-9b75-89eeb893b641 req-b6e1e41c-0311-41fe-a75c-31c77e6b435d service nova] Creating event network-vif-deleted:c2c3c673-aaaa-4c62-aab9-081b1255a165 for instance 66eaff4b-86d0-4d8c-94d9-16ade66ef315 on hv-cinder-85272 Aug 10 17:19:12.268625 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-f99c0c6e-e44a-4647-9b75-89eeb893b641 req-b6e1e41c-0311-41fe-a75c-31c77e6b435d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032020 Aug 10 17:19:12.269292 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 352/699] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:19:12.749227 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5b53a447-9be6-4782-a581-4e28e6f2afc1 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:12.749805 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5b53a447-9be6-4782-a581-4e28e6f2afc1 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:12.756663 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b53a447-9be6-4782-a581-4e28e6f2afc1 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:12.757153 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b53a447-9be6-4782-a581-4e28e6f2afc1 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:12.757582 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b53a447-9be6-4782-a581-4e28e6f2afc1 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:12.758278 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b53a447-9be6-4782-a581-4e28e6f2afc1 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:12.758757 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b53a447-9be6-4782-a581-4e28e6f2afc1 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:12.759225 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b53a447-9be6-4782-a581-4e28e6f2afc1 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:12.794344 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b53a447-9be6-4782-a581-4e28e6f2afc1 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:12.794858 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b53a447-9be6-4782-a581-4e28e6f2afc1 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:12.795310 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b53a447-9be6-4782-a581-4e28e6f2afc1 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:12.795748 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-5b53a447-9be6-4782-a581-4e28e6f2afc1 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lazy-loading 'fault' on Instance uuid 66eaff4b-86d0-4d8c-94d9-16ade66ef315 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:19:12.841326 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5b53a447-9be6-4782-a581-4e28e6f2afc1 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa1fc74f5fd48a7846d44337374d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5034c1fae4e369eb74852eb185468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:12.849338 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5b53a447-9be6-4782-a581-4e28e6f2afc1 tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 200 len: 1304 microversion: 2.1 time: 0.104120 Aug 10 17:19:12.850011 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 348/700] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:12 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:12.945883 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b30abdc3-5cf9-4fab-8d48-8a6dbc992e6b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:12.946623 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b30abdc3-5cf9-4fab-8d48-8a6dbc992e6b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:12.955911 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b30abdc3-5cf9-4fab-8d48-8a6dbc992e6b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:12.955911 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b30abdc3-5cf9-4fab-8d48-8a6dbc992e6b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:12.955911 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b30abdc3-5cf9-4fab-8d48-8a6dbc992e6b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:12.955911 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b30abdc3-5cf9-4fab-8d48-8a6dbc992e6b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:12.956963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b30abdc3-5cf9-4fab-8d48-8a6dbc992e6b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:12.956963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b30abdc3-5cf9-4fab-8d48-8a6dbc992e6b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:13.094634 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b30abdc3-5cf9-4fab-8d48-8a6dbc992e6b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:13.103956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b30abdc3-5cf9-4fab-8d48-8a6dbc992e6b tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1728 microversion: 2.1 time: 0.163175 Aug 10 17:19:13.104542 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 353/701] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:12 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:13.126136 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5f0af19f-3bcf-473c-b9d9-dfcf9c3b3766 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:13.126672 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5f0af19f-3bcf-473c-b9d9-dfcf9c3b3766 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:13.133346 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f0af19f-3bcf-473c-b9d9-dfcf9c3b3766 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:13.133852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f0af19f-3bcf-473c-b9d9-dfcf9c3b3766 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:13.134559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f0af19f-3bcf-473c-b9d9-dfcf9c3b3766 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:13.135273 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f0af19f-3bcf-473c-b9d9-dfcf9c3b3766 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:13.135752 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f0af19f-3bcf-473c-b9d9-dfcf9c3b3766 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:13.136374 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f0af19f-3bcf-473c-b9d9-dfcf9c3b3766 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:13.220759 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5f0af19f-3bcf-473c-b9d9-dfcf9c3b3766 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098446 Aug 10 17:19:13.221355 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 349/702] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 17:19:13 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:19:13.871425 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-536b4fef-25cc-4328-aaaa-3defaf12723c tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:13.872046 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-536b4fef-25cc-4328-aaaa-3defaf12723c tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] [instance: 66eaff4b-86d0-4d8c-94d9-16ade66ef315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:13.878142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-536b4fef-25cc-4328-aaaa-3defaf12723c tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:13.878664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-536b4fef-25cc-4328-aaaa-3defaf12723c tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:13.879622 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-536b4fef-25cc-4328-aaaa-3defaf12723c tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:13.880336 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-536b4fef-25cc-4328-aaaa-3defaf12723c tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:13.880797 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-536b4fef-25cc-4328-aaaa-3defaf12723c tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:13.881221 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-536b4fef-25cc-4328-aaaa-3defaf12723c tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:13.897974 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-536b4fef-25cc-4328-aaaa-3defaf12723c tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] HTTP exception thrown: Instance 66eaff4b-86d0-4d8c-94d9-16ade66ef315 could not be found. Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-536b4fef-25cc-4328-aaaa-3defaf12723c tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Request method failure captured: Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 HTTP/1.1 Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-h5M2DubZImHFFWwwKGzl7O4oFc6j41AqbvmQK9EMQFvvYP2OiPYBs_ycY7GH0lAH7yoG1N2j13u0Cby6sDYWzGAE4NiyLgcVbcDWWDRK0GrQVLMZ-g56t14cLKq-TmQuMtnAtAscScp6s25hTnPvpbVLRnx7_OJR7HcLR4WIRG-Pg Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: 8dd5034c1fae4e369eb74852eb185468 Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesNegativeTest-490729522 Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:19:13.899687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:19:13.901492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8dd5034c1fae4e369eb74852eb185468", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8dd5034c1fae4e369eb74852eb185468"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8dd5034c1fae4e369eb74852eb185468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8dd5034c1fae4e369eb74852eb185468"}]}] Aug 10 17:19:13.901492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesNegativeTest-490729522 Aug 10 17:19:13.901492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 8dd5034c1fae4e369eb74852eb185468 Aug 10 17:19:13.901492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesNegativeTest-490729522 Aug 10 17:19:13.901492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesNegativeTest-490729522-project Aug 10 17:19:13.901492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:19:13.901492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:19:13.901492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: baa1fc74f5fd48a7846d44337374d480 Aug 10 17:19:13.901492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesNegativeTest-490729522-project Aug 10 17:19:13.901492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:19:13.901492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance 66eaff4b-86d0-4d8c-94d9-16ade66ef315 could not be found. Aug 10 17:19:13.901492 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': '66eaff4b-86d0-4d8c-94d9-16ade66ef315'} Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66eaff4b-86d0-4d8c-94d9-16ade66ef315 could not be found. Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:19:13.902447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66eaff4b-86d0-4d8c-94d9-16ade66ef315 could not be found. Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66eaff4b-86d0-4d8c-94d9-16ade66ef315 could not be found. Aug 10 17:19:13.903961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:19:13.905242 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-536b4fef-25cc-4328-aaaa-3defaf12723c tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] Returning 404 to user: Instance 66eaff4b-86d0-4d8c-94d9-16ade66ef315 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:19:13.905242 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-536b4fef-25cc-4328-aaaa-3defaf12723c tempest-VolumesNegativeTest-490729522 tempest-VolumesNegativeTest-490729522-project] 10.222.0.45 "GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315" status: 404 len: 111 microversion: 2.1 time: 0.033843 Aug 10 17:19:13.905242 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 354/703] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:13 2022] GET /compute/v2.1/servers/66eaff4b-86d0-4d8c-94d9-16ade66ef315 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:19:14.289920 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-66fd488f-c7f2-48e6-9dda-81bcb222dc77 req-65966dad-509b-47c7-a53f-64758d8943af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a02347-095c-4aa2-92b0-5bcdf5fce2a9", "tag": "f75a7b46-ae6b-4d8e-bf2e-f099e435733a"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:14.310130 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-66fd488f-c7f2-48e6-9dda-81bcb222dc77 req-65966dad-509b-47c7-a53f-64758d8943af service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:14.310762 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-66fd488f-c7f2-48e6-9dda-81bcb222dc77 req-65966dad-509b-47c7-a53f-64758d8943af service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:14.311390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-66fd488f-c7f2-48e6-9dda-81bcb222dc77 req-65966dad-509b-47c7-a53f-64758d8943af service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:14.324667 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-66fd488f-c7f2-48e6-9dda-81bcb222dc77 req-65966dad-509b-47c7-a53f-64758d8943af service nova] Creating event network-changed:f75a7b46-ae6b-4d8e-bf2e-f099e435733a for instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 on hv-cinder-85272 Aug 10 17:19:14.330345 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-66fd488f-c7f2-48e6-9dda-81bcb222dc77 req-65966dad-509b-47c7-a53f-64758d8943af service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044964 Aug 10 17:19:14.331468 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 350/704] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:19:16.346878 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-03ef02c6-a315-4d96-95a6-3f505bf8cdc3 req-2b260c22-31e6-40a7-bfcb-854c9d39444f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a02347-095c-4aa2-92b0-5bcdf5fce2a9", "tag": "f75a7b46-ae6b-4d8e-bf2e-f099e435733a"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:16.357102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-03ef02c6-a315-4d96-95a6-3f505bf8cdc3 req-2b260c22-31e6-40a7-bfcb-854c9d39444f service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:16.362587 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-03ef02c6-a315-4d96-95a6-3f505bf8cdc3 req-2b260c22-31e6-40a7-bfcb-854c9d39444f service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:16.362587 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-03ef02c6-a315-4d96-95a6-3f505bf8cdc3 req-2b260c22-31e6-40a7-bfcb-854c9d39444f service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:16.372010 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-03ef02c6-a315-4d96-95a6-3f505bf8cdc3 req-2b260c22-31e6-40a7-bfcb-854c9d39444f service nova] Creating event network-changed:f75a7b46-ae6b-4d8e-bf2e-f099e435733a for instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 on hv-cinder-85272 Aug 10 17:19:16.376766 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-03ef02c6-a315-4d96-95a6-3f505bf8cdc3 req-2b260c22-31e6-40a7-bfcb-854c9d39444f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033784 Aug 10 17:19:16.377388 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 355/705] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:19:21.835776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0f7a3d00-34be-46c7-82fa-5e7f8c306bd0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:21.836361 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0f7a3d00-34be-46c7-82fa-5e7f8c306bd0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:21.838297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:21.843756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f7a3d00-34be-46c7-82fa-5e7f8c306bd0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:21.844241 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f7a3d00-34be-46c7-82fa-5e7f8c306bd0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:21.844983 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f7a3d00-34be-46c7-82fa-5e7f8c306bd0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:21.845759 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f7a3d00-34be-46c7-82fa-5e7f8c306bd0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:21.846220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f7a3d00-34be-46c7-82fa-5e7f8c306bd0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:21.846673 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f7a3d00-34be-46c7-82fa-5e7f8c306bd0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:21.879822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0f7a3d00-34be-46c7-82fa-5e7f8c306bd0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/os-volume_attachments/4fd9d3a4-d158-432a-838c-e99e974fb4a0" status: 200 len: 194 microversion: 2.20 time: 0.048592 Aug 10 17:19:21.880474 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 351/706] 10.222.0.45 () {60 vars in 1454 bytes} [Wed Aug 10 17:19:21 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/os-volume_attachments/4fd9d3a4-d158-432a-838c-e99e974fb4a0 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:19:21.950245 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-82f94ebe-90cf-4a09-819a-5790fc14c501 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:21.950867 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-82f94ebe-90cf-4a09-819a-5790fc14c501 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:21.958858 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82f94ebe-90cf-4a09-819a-5790fc14c501 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:21.959313 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82f94ebe-90cf-4a09-819a-5790fc14c501 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:21.959940 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82f94ebe-90cf-4a09-819a-5790fc14c501 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:21.960661 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82f94ebe-90cf-4a09-819a-5790fc14c501 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:21.961122 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82f94ebe-90cf-4a09-819a-5790fc14c501 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:21.961554 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82f94ebe-90cf-4a09-819a-5790fc14c501 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:22.046849 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-82f94ebe-90cf-4a09-819a-5790fc14c501 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lazy-loading 'services' on Instance uuid 1e46673f-6139-4b97-b57a-b65886eb16b1 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:19:22.321955 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-82f94ebe-90cf-4a09-819a-5790fc14c501 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/os-volume_attachments/4fd9d3a4-d158-432a-838c-e99e974fb4a0" status: 202 len: 0 microversion: 2.20 time: 0.375835 Aug 10 17:19:22.322664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 356/707] 10.222.0.45 () {60 vars in 1457 bytes} [Wed Aug 10 17:19:21 2022] DELETE /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/os-volume_attachments/4fd9d3a4-d158-432a-838c-e99e974fb4a0 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:19:22.331430 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9f4430a1-9d63-4a34-a00f-8715d927868a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:22.333611 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9f4430a1-9d63-4a34-a00f-8715d927868a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:22.340058 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f4430a1-9d63-4a34-a00f-8715d927868a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:22.346865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f4430a1-9d63-4a34-a00f-8715d927868a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:22.346865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f4430a1-9d63-4a34-a00f-8715d927868a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:22.346865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f4430a1-9d63-4a34-a00f-8715d927868a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:22.346865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f4430a1-9d63-4a34-a00f-8715d927868a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:22.347241 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f4430a1-9d63-4a34-a00f-8715d927868a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:22.373696 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9f4430a1-9d63-4a34-a00f-8715d927868a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046534 Aug 10 17:19:22.374335 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 352/708] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 10 17:19:22 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:19:23.387983 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6f2f96d5-c600-4acf-b789-9ede48e5f9b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:23.390285 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6f2f96d5-c600-4acf-b789-9ede48e5f9b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:23.396988 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f2f96d5-c600-4acf-b789-9ede48e5f9b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:23.397469 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f2f96d5-c600-4acf-b789-9ede48e5f9b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:23.397903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f2f96d5-c600-4acf-b789-9ede48e5f9b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:23.398632 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f2f96d5-c600-4acf-b789-9ede48e5f9b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:23.399087 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f2f96d5-c600-4acf-b789-9ede48e5f9b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:23.399507 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f2f96d5-c600-4acf-b789-9ede48e5f9b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:23.429292 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6f2f96d5-c600-4acf-b789-9ede48e5f9b4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046579 Aug 10 17:19:23.429849 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 357/709] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 10 17:19:23 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:19:24.442498 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-64c8df11-1cbb-43fa-af97-0dcb14f5ec59 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:24.444621 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-64c8df11-1cbb-43fa-af97-0dcb14f5ec59 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:24.451722 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-64c8df11-1cbb-43fa-af97-0dcb14f5ec59 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:24.452213 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-64c8df11-1cbb-43fa-af97-0dcb14f5ec59 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:24.452655 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-64c8df11-1cbb-43fa-af97-0dcb14f5ec59 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:24.453356 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-64c8df11-1cbb-43fa-af97-0dcb14f5ec59 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:24.454142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-64c8df11-1cbb-43fa-af97-0dcb14f5ec59 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:24.454599 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-64c8df11-1cbb-43fa-af97-0dcb14f5ec59 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:24.484563 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-64c8df11-1cbb-43fa-af97-0dcb14f5ec59 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047203 Aug 10 17:19:24.485158 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 353/710] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 10 17:19:24 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:24.549614 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4c40ca9a-f6de-436f-b5d0-0f129842f19a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:24.550112 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4c40ca9a-f6de-436f-b5d0-0f129842f19a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:24.556654 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c40ca9a-f6de-436f-b5d0-0f129842f19a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:24.557337 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c40ca9a-f6de-436f-b5d0-0f129842f19a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:24.557784 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c40ca9a-f6de-436f-b5d0-0f129842f19a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:24.558515 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c40ca9a-f6de-436f-b5d0-0f129842f19a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:24.558970 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c40ca9a-f6de-436f-b5d0-0f129842f19a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:24.559398 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c40ca9a-f6de-436f-b5d0-0f129842f19a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:24.585270 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4c40ca9a-f6de-436f-b5d0-0f129842f19a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:19:24.945728 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4c40ca9a-f6de-436f-b5d0-0f129842f19a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 204 len: 0 microversion: 2.20 time: 0.399749 Aug 10 17:19:24.946370 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 358/711] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 10 17:19:24 2022] DELETE /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:19:24.954568 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-35e47264-f1f7-4cff-8b8d-9d3998b0053f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:24.955167 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-35e47264-f1f7-4cff-8b8d-9d3998b0053f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:24.961759 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35e47264-f1f7-4cff-8b8d-9d3998b0053f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:24.962243 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35e47264-f1f7-4cff-8b8d-9d3998b0053f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:24.962703 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35e47264-f1f7-4cff-8b8d-9d3998b0053f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:24.963395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35e47264-f1f7-4cff-8b8d-9d3998b0053f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:24.963849 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35e47264-f1f7-4cff-8b8d-9d3998b0053f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:24.964268 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35e47264-f1f7-4cff-8b8d-9d3998b0053f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:24.974739 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-34b15afb-2127-4bd6-b85a-3cd54cde18a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:24.977689 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-34b15afb-2127-4bd6-b85a-3cd54cde18a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:24.983952 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34b15afb-2127-4bd6-b85a-3cd54cde18a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:24.984434 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34b15afb-2127-4bd6-b85a-3cd54cde18a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:24.984872 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34b15afb-2127-4bd6-b85a-3cd54cde18a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:24.995801 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34b15afb-2127-4bd6-b85a-3cd54cde18a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:24.995801 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34b15afb-2127-4bd6-b85a-3cd54cde18a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:24.995801 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34b15afb-2127-4bd6-b85a-3cd54cde18a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:25.018404 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-34b15afb-2127-4bd6-b85a-3cd54cde18a4 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048590 Aug 10 17:19:25.019272 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 359/712] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:19:24 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 17:19:25.087374 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2895a718-285e-445d-a4c8-bcd50cff3ad7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:25.087943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2895a718-285e-445d-a4c8-bcd50cff3ad7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:25.093890 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2895a718-285e-445d-a4c8-bcd50cff3ad7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:25.094372 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2895a718-285e-445d-a4c8-bcd50cff3ad7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:25.094825 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2895a718-285e-445d-a4c8-bcd50cff3ad7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:25.095531 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2895a718-285e-445d-a4c8-bcd50cff3ad7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:25.096048 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2895a718-285e-445d-a4c8-bcd50cff3ad7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:25.096487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2895a718-285e-445d-a4c8-bcd50cff3ad7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:25.103066 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-35e47264-f1f7-4cff-8b8d-9d3998b0053f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:25.110941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-35e47264-f1f7-4cff-8b8d-9d3998b0053f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:25.113072 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-35e47264-f1f7-4cff-8b8d-9d3998b0053f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:25.114246 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-35e47264-f1f7-4cff-8b8d-9d3998b0053f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.163138 Aug 10 17:19:25.115537 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 354/713] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:24 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:25.130123 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2895a718-285e-445d-a4c8-bcd50cff3ad7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:19:25.561716 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2895a718-285e-445d-a4c8-bcd50cff3ad7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 204 len: 0 microversion: 2.1 time: 0.478060 Aug 10 17:19:25.562412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 360/714] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:19:25 2022] DELETE /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:19:25.570413 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1aae743f-94d8-4e1c-a5e9-431cc58264ae tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:25.571031 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1aae743f-94d8-4e1c-a5e9-431cc58264ae tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:25.577315 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aae743f-94d8-4e1c-a5e9-431cc58264ae tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:25.581177 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aae743f-94d8-4e1c-a5e9-431cc58264ae tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:25.581177 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aae743f-94d8-4e1c-a5e9-431cc58264ae tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:25.581177 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aae743f-94d8-4e1c-a5e9-431cc58264ae tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:25.581177 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aae743f-94d8-4e1c-a5e9-431cc58264ae tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:25.581716 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aae743f-94d8-4e1c-a5e9-431cc58264ae tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:25.710220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1aae743f-94d8-4e1c-a5e9-431cc58264ae tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:25.717820 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1aae743f-94d8-4e1c-a5e9-431cc58264ae tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1673 microversion: 2.1 time: 0.151296 Aug 10 17:19:25.718427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 355/715] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:25 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:26.138161 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-62ab9379-648c-48cb-9935-e04d2101ac97 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:26.138891 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-62ab9379-648c-48cb-9935-e04d2101ac97 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:26.144931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62ab9379-648c-48cb-9935-e04d2101ac97 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:26.145509 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62ab9379-648c-48cb-9935-e04d2101ac97 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:26.145961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62ab9379-648c-48cb-9935-e04d2101ac97 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:26.146688 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62ab9379-648c-48cb-9935-e04d2101ac97 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:26.147147 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62ab9379-648c-48cb-9935-e04d2101ac97 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:26.147571 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62ab9379-648c-48cb-9935-e04d2101ac97 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:26.164445 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=94,nova_cell1:UPDATE=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:26.283328 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-62ab9379-648c-48cb-9935-e04d2101ac97 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:26.291459 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-62ab9379-648c-48cb-9935-e04d2101ac97 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:26.292957 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-62ab9379-648c-48cb-9935-e04d2101ac97 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:26.294103 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-62ab9379-648c-48cb-9935-e04d2101ac97 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.160596 Aug 10 17:19:26.294701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 361/716] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:26 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:26.740058 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ba7a750d-b335-4894-8ec9-1ac875708672 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:26.740610 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ba7a750d-b335-4894-8ec9-1ac875708672 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:26.747089 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba7a750d-b335-4894-8ec9-1ac875708672 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:26.747570 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba7a750d-b335-4894-8ec9-1ac875708672 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:26.748009 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba7a750d-b335-4894-8ec9-1ac875708672 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:26.748696 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba7a750d-b335-4894-8ec9-1ac875708672 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:26.749147 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba7a750d-b335-4894-8ec9-1ac875708672 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:26.749608 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba7a750d-b335-4894-8ec9-1ac875708672 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:26.881929 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ba7a750d-b335-4894-8ec9-1ac875708672 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:26.889789 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ba7a750d-b335-4894-8ec9-1ac875708672 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1673 microversion: 2.1 time: 0.154150 Aug 10 17:19:26.890376 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 356/717] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:26 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:27.318654 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-549dfe5f-3fb3-41dc-92de-90f748dbf9a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:27.319273 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-549dfe5f-3fb3-41dc-92de-90f748dbf9a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:27.326143 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-549dfe5f-3fb3-41dc-92de-90f748dbf9a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:27.326672 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-549dfe5f-3fb3-41dc-92de-90f748dbf9a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:27.327118 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-549dfe5f-3fb3-41dc-92de-90f748dbf9a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:27.327815 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-549dfe5f-3fb3-41dc-92de-90f748dbf9a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:27.328406 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-549dfe5f-3fb3-41dc-92de-90f748dbf9a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:27.329166 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-549dfe5f-3fb3-41dc-92de-90f748dbf9a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:27.462977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-549dfe5f-3fb3-41dc-92de-90f748dbf9a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:27.471088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-549dfe5f-3fb3-41dc-92de-90f748dbf9a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:27.472578 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-549dfe5f-3fb3-41dc-92de-90f748dbf9a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:27.474255 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-549dfe5f-3fb3-41dc-92de-90f748dbf9a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.159618 Aug 10 17:19:27.474863 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 362/718] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:27 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:27.911427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-90dfaa42-641c-4ba4-bae1-dd96ad7bcd14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:27.912035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-90dfaa42-641c-4ba4-bae1-dd96ad7bcd14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:27.918392 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90dfaa42-641c-4ba4-bae1-dd96ad7bcd14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:27.918875 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90dfaa42-641c-4ba4-bae1-dd96ad7bcd14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:27.919304 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90dfaa42-641c-4ba4-bae1-dd96ad7bcd14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:27.920031 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90dfaa42-641c-4ba4-bae1-dd96ad7bcd14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:27.920472 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90dfaa42-641c-4ba4-bae1-dd96ad7bcd14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:27.920888 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90dfaa42-641c-4ba4-bae1-dd96ad7bcd14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:28.050982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-90dfaa42-641c-4ba4-bae1-dd96ad7bcd14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:28.058589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-90dfaa42-641c-4ba4-bae1-dd96ad7bcd14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1673 microversion: 2.1 time: 0.151690 Aug 10 17:19:28.059148 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 357/719] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:27 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:28.497790 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-35d572ae-2331-4e7d-a02d-7b871cd9d866 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:28.498583 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-35d572ae-2331-4e7d-a02d-7b871cd9d866 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:28.505801 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35d572ae-2331-4e7d-a02d-7b871cd9d866 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:28.506294 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35d572ae-2331-4e7d-a02d-7b871cd9d866 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:28.506758 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35d572ae-2331-4e7d-a02d-7b871cd9d866 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:28.507520 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35d572ae-2331-4e7d-a02d-7b871cd9d866 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:28.507964 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35d572ae-2331-4e7d-a02d-7b871cd9d866 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:28.508386 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35d572ae-2331-4e7d-a02d-7b871cd9d866 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:28.645510 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-35d572ae-2331-4e7d-a02d-7b871cd9d866 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:28.653735 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-35d572ae-2331-4e7d-a02d-7b871cd9d866 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:28.655288 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-35d572ae-2331-4e7d-a02d-7b871cd9d866 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:28.656457 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-35d572ae-2331-4e7d-a02d-7b871cd9d866 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.163348 Aug 10 17:19:28.657019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 363/720] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:28 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:29.080752 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-29a97819-e18c-4764-87bf-31d755d14fdd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:29.081513 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-29a97819-e18c-4764-87bf-31d755d14fdd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:29.088703 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a97819-e18c-4764-87bf-31d755d14fdd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:29.089197 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a97819-e18c-4764-87bf-31d755d14fdd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:29.089640 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a97819-e18c-4764-87bf-31d755d14fdd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:29.090340 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a97819-e18c-4764-87bf-31d755d14fdd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:29.090822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a97819-e18c-4764-87bf-31d755d14fdd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:29.091252 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a97819-e18c-4764-87bf-31d755d14fdd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:29.222913 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-29a97819-e18c-4764-87bf-31d755d14fdd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:29.231192 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-29a97819-e18c-4764-87bf-31d755d14fdd tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1673 microversion: 2.1 time: 0.154491 Aug 10 17:19:29.231762 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 358/721] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:29 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:29.679799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0ad5941a-3c48-4d48-867e-4c17d00ac4d5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:29.680439 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0ad5941a-3c48-4d48-867e-4c17d00ac4d5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:29.686870 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ad5941a-3c48-4d48-867e-4c17d00ac4d5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:29.687359 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ad5941a-3c48-4d48-867e-4c17d00ac4d5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:29.687801 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ad5941a-3c48-4d48-867e-4c17d00ac4d5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:29.688493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ad5941a-3c48-4d48-867e-4c17d00ac4d5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:29.688955 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ad5941a-3c48-4d48-867e-4c17d00ac4d5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:29.689388 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ad5941a-3c48-4d48-867e-4c17d00ac4d5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:29.818842 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0ad5941a-3c48-4d48-867e-4c17d00ac4d5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:29.826830 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0ad5941a-3c48-4d48-867e-4c17d00ac4d5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:29.828349 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0ad5941a-3c48-4d48-867e-4c17d00ac4d5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:29.829510 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0ad5941a-3c48-4d48-867e-4c17d00ac4d5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.153793 Aug 10 17:19:29.830073 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 364/722] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:29 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:30.252734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e05e32e9-2484-49ee-9978-1e6067936039 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:30.253257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e05e32e9-2484-49ee-9978-1e6067936039 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:30.260159 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e05e32e9-2484-49ee-9978-1e6067936039 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:30.260640 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e05e32e9-2484-49ee-9978-1e6067936039 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:30.261067 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e05e32e9-2484-49ee-9978-1e6067936039 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:30.261748 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e05e32e9-2484-49ee-9978-1e6067936039 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:30.262200 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e05e32e9-2484-49ee-9978-1e6067936039 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:30.262649 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e05e32e9-2484-49ee-9978-1e6067936039 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:30.394702 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e05e32e9-2484-49ee-9978-1e6067936039 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:30.402626 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e05e32e9-2484-49ee-9978-1e6067936039 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1673 microversion: 2.1 time: 0.153755 Aug 10 17:19:30.403200 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 359/723] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:30 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:30.853439 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fa673c43-36ac-4f71-a06d-513b9a2e2c2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:30.854042 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fa673c43-36ac-4f71-a06d-513b9a2e2c2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:30.860461 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa673c43-36ac-4f71-a06d-513b9a2e2c2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:30.860884 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa673c43-36ac-4f71-a06d-513b9a2e2c2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:30.861316 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa673c43-36ac-4f71-a06d-513b9a2e2c2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:30.861997 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa673c43-36ac-4f71-a06d-513b9a2e2c2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:30.862480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa673c43-36ac-4f71-a06d-513b9a2e2c2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:30.862903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa673c43-36ac-4f71-a06d-513b9a2e2c2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:30.995892 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fa673c43-36ac-4f71-a06d-513b9a2e2c2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:31.003713 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fa673c43-36ac-4f71-a06d-513b9a2e2c2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:31.005231 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fa673c43-36ac-4f71-a06d-513b9a2e2c2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:31.006582 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fa673c43-36ac-4f71-a06d-513b9a2e2c2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.157716 Aug 10 17:19:31.007170 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 365/724] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:30 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:31.424345 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7ec77cd2-ba76-4c48-a575-470b128b57a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:31.424966 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7ec77cd2-ba76-4c48-a575-470b128b57a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:31.431538 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7ec77cd2-ba76-4c48-a575-470b128b57a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:31.432030 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7ec77cd2-ba76-4c48-a575-470b128b57a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:31.432510 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7ec77cd2-ba76-4c48-a575-470b128b57a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:31.433239 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7ec77cd2-ba76-4c48-a575-470b128b57a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:31.433695 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7ec77cd2-ba76-4c48-a575-470b128b57a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:31.434118 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7ec77cd2-ba76-4c48-a575-470b128b57a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:31.566478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7ec77cd2-ba76-4c48-a575-470b128b57a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:31.574054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7ec77cd2-ba76-4c48-a575-470b128b57a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1673 microversion: 2.1 time: 0.153584 Aug 10 17:19:31.574769 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 360/725] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:31 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:32.029945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-04cd3df8-8c71-4398-b586-83204983e094 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:32.030593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-04cd3df8-8c71-4398-b586-83204983e094 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:32.037014 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04cd3df8-8c71-4398-b586-83204983e094 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:32.037555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04cd3df8-8c71-4398-b586-83204983e094 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:32.038105 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04cd3df8-8c71-4398-b586-83204983e094 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:32.038837 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04cd3df8-8c71-4398-b586-83204983e094 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:32.039298 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04cd3df8-8c71-4398-b586-83204983e094 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:32.039746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04cd3df8-8c71-4398-b586-83204983e094 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:32.169318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-04cd3df8-8c71-4398-b586-83204983e094 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:32.177263 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-04cd3df8-8c71-4398-b586-83204983e094 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:32.179393 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-04cd3df8-8c71-4398-b586-83204983e094 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:32.180557 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-04cd3df8-8c71-4398-b586-83204983e094 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.154588 Aug 10 17:19:32.181113 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 366/726] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:32 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:32.595917 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-65c665e6-0c71-473e-8933-9cbc1b1685b2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:32.596533 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-65c665e6-0c71-473e-8933-9cbc1b1685b2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:32.603522 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65c665e6-0c71-473e-8933-9cbc1b1685b2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:32.604014 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65c665e6-0c71-473e-8933-9cbc1b1685b2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:32.604458 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65c665e6-0c71-473e-8933-9cbc1b1685b2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:32.605331 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65c665e6-0c71-473e-8933-9cbc1b1685b2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:32.605793 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65c665e6-0c71-473e-8933-9cbc1b1685b2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:32.606222 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65c665e6-0c71-473e-8933-9cbc1b1685b2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:32.737000 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-65c665e6-0c71-473e-8933-9cbc1b1685b2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:32.745628 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-65c665e6-0c71-473e-8933-9cbc1b1685b2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1673 microversion: 2.1 time: 0.153896 Aug 10 17:19:32.749966 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 361/727] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:32 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:33.204152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f9d38339-524a-4e26-8fe0-ae315b87d5ee tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:33.204776 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f9d38339-524a-4e26-8fe0-ae315b87d5ee tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:33.207083 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:33.215979 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9d38339-524a-4e26-8fe0-ae315b87d5ee tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:33.215979 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9d38339-524a-4e26-8fe0-ae315b87d5ee tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:33.215979 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9d38339-524a-4e26-8fe0-ae315b87d5ee tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:33.215979 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9d38339-524a-4e26-8fe0-ae315b87d5ee tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:33.216396 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9d38339-524a-4e26-8fe0-ae315b87d5ee tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:33.216396 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9d38339-524a-4e26-8fe0-ae315b87d5ee tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:33.349183 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f9d38339-524a-4e26-8fe0-ae315b87d5ee tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:33.357045 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f9d38339-524a-4e26-8fe0-ae315b87d5ee tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:33.358577 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f9d38339-524a-4e26-8fe0-ae315b87d5ee tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:33.359721 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f9d38339-524a-4e26-8fe0-ae315b87d5ee tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.159535 Aug 10 17:19:33.360265 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 367/728] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:33 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:33.927649 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1a519c6c-72a5-40c2-8822-e2a8f72e46e0 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:33.928901 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1a519c6c-72a5-40c2-8822-e2a8f72e46e0 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:33.935120 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a519c6c-72a5-40c2-8822-e2a8f72e46e0 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:33.935609 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a519c6c-72a5-40c2-8822-e2a8f72e46e0 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:33.936076 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a519c6c-72a5-40c2-8822-e2a8f72e46e0 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:33.936820 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a519c6c-72a5-40c2-8822-e2a8f72e46e0 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:33.937276 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a519c6c-72a5-40c2-8822-e2a8f72e46e0 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:33.937698 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a519c6c-72a5-40c2-8822-e2a8f72e46e0 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:34.071488 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1a519c6c-72a5-40c2-8822-e2a8f72e46e0 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:34.074912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:34.079281 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1a519c6c-72a5-40c2-8822-e2a8f72e46e0 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1673 microversion: 2.1 time: 0.316394 Aug 10 17:19:34.079856 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 362/729] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:33 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1673 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:34.489194 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ac074ccc-e353-4f78-bb33-16985b03fe77 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:34.490149 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ac074ccc-e353-4f78-bb33-16985b03fe77 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:34.495973 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac074ccc-e353-4f78-bb33-16985b03fe77 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:34.496465 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac074ccc-e353-4f78-bb33-16985b03fe77 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:34.496999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac074ccc-e353-4f78-bb33-16985b03fe77 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:34.497616 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac074ccc-e353-4f78-bb33-16985b03fe77 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:34.498070 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac074ccc-e353-4f78-bb33-16985b03fe77 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:34.498562 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac074ccc-e353-4f78-bb33-16985b03fe77 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:34.633087 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ac074ccc-e353-4f78-bb33-16985b03fe77 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:34.641381 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ac074ccc-e353-4f78-bb33-16985b03fe77 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:34.642865 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ac074ccc-e353-4f78-bb33-16985b03fe77 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:34.644059 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ac074ccc-e353-4f78-bb33-16985b03fe77 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.265297 Aug 10 17:19:34.644613 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 368/730] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:34 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:35.100400 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f7446641-5ce9-45aa-ae61-065ceedd36ba tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:35.101016 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f7446641-5ce9-45aa-ae61-065ceedd36ba tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:35.107612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f7446641-5ce9-45aa-ae61-065ceedd36ba tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:35.108100 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f7446641-5ce9-45aa-ae61-065ceedd36ba tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:35.108538 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f7446641-5ce9-45aa-ae61-065ceedd36ba tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:35.109228 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f7446641-5ce9-45aa-ae61-065ceedd36ba tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:35.109689 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f7446641-5ce9-45aa-ae61-065ceedd36ba tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:35.110114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f7446641-5ce9-45aa-ae61-065ceedd36ba tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:35.237709 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f7446641-5ce9-45aa-ae61-065ceedd36ba tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:35.245954 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f7446641-5ce9-45aa-ae61-065ceedd36ba tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1673 microversion: 2.1 time: 0.149780 Aug 10 17:19:35.246547 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 363/731] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:35 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:35.667946 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-019b883b-ed1c-4ee8-8f26-776194f903a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:35.668566 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-019b883b-ed1c-4ee8-8f26-776194f903a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:35.675012 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-019b883b-ed1c-4ee8-8f26-776194f903a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:35.675490 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-019b883b-ed1c-4ee8-8f26-776194f903a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:35.675922 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-019b883b-ed1c-4ee8-8f26-776194f903a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:35.676605 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-019b883b-ed1c-4ee8-8f26-776194f903a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:35.677058 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-019b883b-ed1c-4ee8-8f26-776194f903a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:35.677479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-019b883b-ed1c-4ee8-8f26-776194f903a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:35.810232 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-019b883b-ed1c-4ee8-8f26-776194f903a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:35.818183 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-019b883b-ed1c-4ee8-8f26-776194f903a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:35.820001 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-019b883b-ed1c-4ee8-8f26-776194f903a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:35.821158 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-019b883b-ed1c-4ee8-8f26-776194f903a8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.157355 Aug 10 17:19:35.821706 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 369/732] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:35 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:36.268102 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-21afa2f6-b0b8-4cd4-9d12-d95058226166 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:36.268709 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-21afa2f6-b0b8-4cd4-9d12-d95058226166 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:36.275257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21afa2f6-b0b8-4cd4-9d12-d95058226166 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:36.275772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21afa2f6-b0b8-4cd4-9d12-d95058226166 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:36.276209 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21afa2f6-b0b8-4cd4-9d12-d95058226166 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:36.276894 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21afa2f6-b0b8-4cd4-9d12-d95058226166 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:36.277347 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21afa2f6-b0b8-4cd4-9d12-d95058226166 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:36.277765 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21afa2f6-b0b8-4cd4-9d12-d95058226166 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:36.409644 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-21afa2f6-b0b8-4cd4-9d12-d95058226166 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:36.417668 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-21afa2f6-b0b8-4cd4-9d12-d95058226166 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1673 microversion: 2.1 time: 0.153423 Aug 10 17:19:36.418232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 364/733] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:36 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:36.652495 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-13108336-e179-462d-8180-f3e71b7ff9c9 req-f13b3920-b9ab-4221-a151-533c9f020d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e46673f-6139-4b97-b57a-b65886eb16b1", "name": "network-vif-unplugged", "status": "completed", "tag": "65857e53-de9a-43a1-9362-2d62644ab14a"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:36.665704 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-13108336-e179-462d-8180-f3e71b7ff9c9 req-f13b3920-b9ab-4221-a151-533c9f020d53 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:36.665704 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-13108336-e179-462d-8180-f3e71b7ff9c9 req-f13b3920-b9ab-4221-a151-533c9f020d53 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:36.665704 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-13108336-e179-462d-8180-f3e71b7ff9c9 req-f13b3920-b9ab-4221-a151-533c9f020d53 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:36.675203 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-13108336-e179-462d-8180-f3e71b7ff9c9 req-f13b3920-b9ab-4221-a151-533c9f020d53 service nova] Creating event network-vif-unplugged:65857e53-de9a-43a1-9362-2d62644ab14a for instance 1e46673f-6139-4b97-b57a-b65886eb16b1 on hv-cinder-85272 Aug 10 17:19:36.680201 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-13108336-e179-462d-8180-f3e71b7ff9c9 req-f13b3920-b9ab-4221-a151-533c9f020d53 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031394 Aug 10 17:19:36.680789 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 370/734] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:19:36.845626 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9f5ad4d9-8f19-480b-b9ce-72e0690f0a4e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:36.846265 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9f5ad4d9-8f19-480b-b9ce-72e0690f0a4e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:36.852943 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f5ad4d9-8f19-480b-b9ce-72e0690f0a4e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:36.853463 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f5ad4d9-8f19-480b-b9ce-72e0690f0a4e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:36.853901 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f5ad4d9-8f19-480b-b9ce-72e0690f0a4e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:36.854616 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f5ad4d9-8f19-480b-b9ce-72e0690f0a4e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:36.855082 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f5ad4d9-8f19-480b-b9ce-72e0690f0a4e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:36.855502 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f5ad4d9-8f19-480b-b9ce-72e0690f0a4e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:36.987405 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9f5ad4d9-8f19-480b-b9ce-72e0690f0a4e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:36.995638 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9f5ad4d9-8f19-480b-b9ce-72e0690f0a4e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:36.997142 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9f5ad4d9-8f19-480b-b9ce-72e0690f0a4e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:36.998342 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9f5ad4d9-8f19-480b-b9ce-72e0690f0a4e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.156727 Aug 10 17:19:36.998928 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 365/735] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:36 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:37.441099 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8c970cd7-bb95-4b4e-9650-0ccef0dab1c8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:37.441902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8c970cd7-bb95-4b4e-9650-0ccef0dab1c8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:37.448891 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c970cd7-bb95-4b4e-9650-0ccef0dab1c8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:37.449381 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c970cd7-bb95-4b4e-9650-0ccef0dab1c8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:37.449815 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c970cd7-bb95-4b4e-9650-0ccef0dab1c8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:37.450557 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c970cd7-bb95-4b4e-9650-0ccef0dab1c8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:37.451012 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c970cd7-bb95-4b4e-9650-0ccef0dab1c8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:37.451436 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c970cd7-bb95-4b4e-9650-0ccef0dab1c8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:37.600704 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8c970cd7-bb95-4b4e-9650-0ccef0dab1c8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:37.609021 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8c970cd7-bb95-4b4e-9650-0ccef0dab1c8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1673 microversion: 2.1 time: 0.173152 Aug 10 17:19:37.623089 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 371/736] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:37 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:38.022762 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-29e76767-1a3a-4db1-a66e-34f96c938870 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:38.024501 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-29e76767-1a3a-4db1-a66e-34f96c938870 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:38.032312 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29e76767-1a3a-4db1-a66e-34f96c938870 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:38.032806 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29e76767-1a3a-4db1-a66e-34f96c938870 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:38.033282 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29e76767-1a3a-4db1-a66e-34f96c938870 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:38.033930 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29e76767-1a3a-4db1-a66e-34f96c938870 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:38.034407 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29e76767-1a3a-4db1-a66e-34f96c938870 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:38.042635 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29e76767-1a3a-4db1-a66e-34f96c938870 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:38.191790 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-29e76767-1a3a-4db1-a66e-34f96c938870 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:38.200825 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-29e76767-1a3a-4db1-a66e-34f96c938870 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:38.202834 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-29e76767-1a3a-4db1-a66e-34f96c938870 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:38.204734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-29e76767-1a3a-4db1-a66e-34f96c938870 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1721 microversion: 2.20 time: 0.185851 Aug 10 17:19:38.218825 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 366/737] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:38 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:38.633593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6f13fe2c-6ffa-4fa9-93f8-25dae7b2ef38 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:38.634571 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6f13fe2c-6ffa-4fa9-93f8-25dae7b2ef38 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:38.640991 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f13fe2c-6ffa-4fa9-93f8-25dae7b2ef38 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:38.641478 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f13fe2c-6ffa-4fa9-93f8-25dae7b2ef38 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:38.642049 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f13fe2c-6ffa-4fa9-93f8-25dae7b2ef38 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:38.642798 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f13fe2c-6ffa-4fa9-93f8-25dae7b2ef38 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:38.643257 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f13fe2c-6ffa-4fa9-93f8-25dae7b2ef38 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:38.643749 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f13fe2c-6ffa-4fa9-93f8-25dae7b2ef38 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:38.707361 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6f13fe2c-6ffa-4fa9-93f8-25dae7b2ef38 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:38.715566 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6f13fe2c-6ffa-4fa9-93f8-25dae7b2ef38 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1606 microversion: 2.1 time: 0.086838 Aug 10 17:19:38.716318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 372/738] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:38 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1606 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:38.948612 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-95abbd74-a3b5-49b6-a79c-befaf17a1714 req-2c188368-511b-4604-a45b-636d4c3e615c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e46673f-6139-4b97-b57a-b65886eb16b1", "name": "network-vif-deleted", "tag": "65857e53-de9a-43a1-9362-2d62644ab14a"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:38.969985 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-95abbd74-a3b5-49b6-a79c-befaf17a1714 req-2c188368-511b-4604-a45b-636d4c3e615c service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:38.973124 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-95abbd74-a3b5-49b6-a79c-befaf17a1714 req-2c188368-511b-4604-a45b-636d4c3e615c service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:38.973649 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-95abbd74-a3b5-49b6-a79c-befaf17a1714 req-2c188368-511b-4604-a45b-636d4c3e615c service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:39.001282 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-95abbd74-a3b5-49b6-a79c-befaf17a1714 req-2c188368-511b-4604-a45b-636d4c3e615c service nova] Creating event network-vif-deleted:65857e53-de9a-43a1-9362-2d62644ab14a for instance 1e46673f-6139-4b97-b57a-b65886eb16b1 on hv-cinder-85272 Aug 10 17:19:39.011728 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-95abbd74-a3b5-49b6-a79c-befaf17a1714 req-2c188368-511b-4604-a45b-636d4c3e615c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067267 Aug 10 17:19:39.015704 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 367/739] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:19:39.229675 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1ec5ac29-e0aa-4e52-8ce7-1056f7e479f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:39.231223 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1ec5ac29-e0aa-4e52-8ce7-1056f7e479f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:39.237328 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ec5ac29-e0aa-4e52-8ce7-1056f7e479f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:39.237932 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ec5ac29-e0aa-4e52-8ce7-1056f7e479f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:39.238501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ec5ac29-e0aa-4e52-8ce7-1056f7e479f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:39.239322 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ec5ac29-e0aa-4e52-8ce7-1056f7e479f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:39.240015 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ec5ac29-e0aa-4e52-8ce7-1056f7e479f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:39.241218 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ec5ac29-e0aa-4e52-8ce7-1056f7e479f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:39.342520 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1ec5ac29-e0aa-4e52-8ce7-1056f7e479f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:39.356475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1ec5ac29-e0aa-4e52-8ce7-1056f7e479f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:39.358575 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1ec5ac29-e0aa-4e52-8ce7-1056f7e479f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:39.360375 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1ec5ac29-e0aa-4e52-8ce7-1056f7e479f2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1366 microversion: 2.20 time: 0.135423 Aug 10 17:19:39.360961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 373/740] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:39 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:39.739145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-965a70c6-cf80-47f2-85ef-8e59f43f9ca8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:39.740541 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-965a70c6-cf80-47f2-85ef-8e59f43f9ca8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:39.748247 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-965a70c6-cf80-47f2-85ef-8e59f43f9ca8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:39.750157 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-965a70c6-cf80-47f2-85ef-8e59f43f9ca8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:39.750656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-965a70c6-cf80-47f2-85ef-8e59f43f9ca8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:39.751383 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-965a70c6-cf80-47f2-85ef-8e59f43f9ca8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:39.751843 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-965a70c6-cf80-47f2-85ef-8e59f43f9ca8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:39.752272 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-965a70c6-cf80-47f2-85ef-8e59f43f9ca8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:39.789128 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-965a70c6-cf80-47f2-85ef-8e59f43f9ca8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:39.789626 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-965a70c6-cf80-47f2-85ef-8e59f43f9ca8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:39.790151 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-965a70c6-cf80-47f2-85ef-8e59f43f9ca8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:39.790632 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-965a70c6-cf80-47f2-85ef-8e59f43f9ca8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lazy-loading 'fault' on Instance uuid ffd37426-ce25-4561-91df-9058dc474b7d {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:19:39.838776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-965a70c6-cf80-47f2-85ef-8e59f43f9ca8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:39.846479 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-965a70c6-cf80-47f2-85ef-8e59f43f9ca8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 200 len: 1328 microversion: 2.1 time: 0.112680 Aug 10 17:19:39.859296 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 368/741] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:39 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 1328 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:40.384993 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:40.385617 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:40.392359 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:40.392850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:40.393297 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:40.394004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:40.394699 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:40.395222 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:40.429769 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:40.430509 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:40.430763 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:40.431288 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lazy-loading 'fault' on Instance uuid 1e46673f-6139-4b97-b57a-b65886eb16b1 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:19:40.474834 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:40.485386 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:40.486620 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:40.488361 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-84a2d1d3-4734-4a5f-9784-e40c682847d1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 200 len: 1371 microversion: 2.20 time: 0.108282 Aug 10 17:19:40.489056 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 374/742] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:40 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:40.870959 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d4822948-7a13-46e0-b143-1c69c5e65ea9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:40.871525 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d4822948-7a13-46e0-b143-1c69c5e65ea9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:40.878100 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d4822948-7a13-46e0-b143-1c69c5e65ea9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:40.878619 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d4822948-7a13-46e0-b143-1c69c5e65ea9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:40.879056 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d4822948-7a13-46e0-b143-1c69c5e65ea9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:40.879741 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d4822948-7a13-46e0-b143-1c69c5e65ea9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:40.880192 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d4822948-7a13-46e0-b143-1c69c5e65ea9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:40.880639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d4822948-7a13-46e0-b143-1c69c5e65ea9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:40.894699 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-d4822948-7a13-46e0-b143-1c69c5e65ea9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] HTTP exception thrown: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d4822948-7a13-46e0-b143-1c69c5e65ea9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Request method failure captured: Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d HTTP/1.1 Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-d5YvUJTscl0tmUlh0361qrv7AI7UnRd2i-kX9PquIkHs68jqx7talr9gFD_UFTDIZDD2RgD0B8ezbRDzIMHv4GfdPb2AQRCo8PqywIIH0qwLEzBHNns8gpByV43VV9sNlR1W9ja0ChhNvdv1_8TyBAUmPbETY-Z8dDU1Th0YV80iA Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: 7e92e1e1c27241798e336e547580be5e Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:19:40.896390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:19:40.898428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7e92e1e1c27241798e336e547580be5e", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7e92e1e1c27241798e336e547580be5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7e92e1e1c27241798e336e547580be5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7e92e1e1c27241798e336e547580be5e"}]}] Aug 10 17:19:40.898428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:19:40.898428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 7e92e1e1c27241798e336e547580be5e Aug 10 17:19:40.898428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:19:40.898428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeTestJSON-2137161467-project Aug 10 17:19:40.898428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:19:40.898428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:19:40.898428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 2f74a20789dc4ef697861146252bacba Aug 10 17:19:40.898428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeTestJSON-2137161467-project Aug 10 17:19:40.898428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:19:40.898428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:19:40.898428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': 'ffd37426-ce25-4561-91df-9058dc474b7d'} Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:19:40.900220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:19:40.902427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:19:40.903794 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d4822948-7a13-46e0-b143-1c69c5e65ea9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Returning 404 to user: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:19:40.903794 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d4822948-7a13-46e0-b143-1c69c5e65ea9 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 404 len: 111 microversion: 2.1 time: 0.032021 Aug 10 17:19:40.903794 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 369/743] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:40 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:19:40.909470 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7bb88014-a720-4853-bdda-3a3b9b44d44c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '.version_select at 0x7f7eb9ec7280>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:41.020928 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7bb88014-a720-4853-bdda-3a3b9b44d44c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792548518" status: 202 len: 0 microversion: 2.1 time: 0.117710 Aug 10 17:19:41.021498 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 375/744] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 10 17:19:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792548518 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:19:41.041289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-e19f85f8-1253-453a-8bd9-c4a57e62cff8 req-787c647b-4dcb-4230-ad5b-31aa06da55bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd37426-ce25-4561-91df-9058dc474b7d", "name": "network-vif-deleted", "tag": "737c9bf5-5977-43d1-a5ab-0601f1af1149"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:41.041289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e19f85f8-1253-453a-8bd9-c4a57e62cff8 req-787c647b-4dcb-4230-ad5b-31aa06da55bd service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:41.041289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e19f85f8-1253-453a-8bd9-c4a57e62cff8 req-787c647b-4dcb-4230-ad5b-31aa06da55bd service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:41.041289 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e19f85f8-1253-453a-8bd9-c4a57e62cff8 req-787c647b-4dcb-4230-ad5b-31aa06da55bd service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:41.052638 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-e19f85f8-1253-453a-8bd9-c4a57e62cff8 req-787c647b-4dcb-4230-ad5b-31aa06da55bd service nova] Creating event network-vif-deleted:737c9bf5-5977-43d1-a5ab-0601f1af1149 for instance ffd37426-ce25-4561-91df-9058dc474b7d on hv-cinder-85272 Aug 10 17:19:41.058715 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-e19f85f8-1253-453a-8bd9-c4a57e62cff8 req-787c647b-4dcb-4230-ad5b-31aa06da55bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032508 Aug 10 17:19:41.059512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 370/745] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:19:41.513272 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-948e0f29-0777-4c28-91ef-59630612729a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:41.513890 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-948e0f29-0777-4c28-91ef-59630612729a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:41.519949 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-948e0f29-0777-4c28-91ef-59630612729a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:41.520420 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-948e0f29-0777-4c28-91ef-59630612729a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:41.521530 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-948e0f29-0777-4c28-91ef-59630612729a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:41.521629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-948e0f29-0777-4c28-91ef-59630612729a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:41.522079 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-948e0f29-0777-4c28-91ef-59630612729a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:41.522689 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-948e0f29-0777-4c28-91ef-59630612729a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:41.536453 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-948e0f29-0777-4c28-91ef-59630612729a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] HTTP exception thrown: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-948e0f29-0777-4c28-91ef-59630612729a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Request method failure captured: Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 HTTP/1.1 Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-d5M2Eh7uj9d9Sk4vRzJNVxf4NcKOw3TZvSUj0PkQN9yMJLDBg07ZQZMuHaZf3w1sXyIDQXUhhNenrFSB5Swy3W1uP1Qjpf5eC4n3s1Z2BqiwAxhwByv34rM8TwcBd-GAj5rdcw_CeuHpRyMjHFRi0JrAQ7rA_hbpEpfKZNtzPIBhI Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: ed45fd312c58480f993616d451abcab7 Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:19:41.538748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:19:41.540163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ed45fd312c58480f993616d451abcab7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ed45fd312c58480f993616d451abcab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ed45fd312c58480f993616d451abcab7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ed45fd312c58480f993616d451abcab7"}]}] Aug 10 17:19:41.540163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:19:41.540163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: ed45fd312c58480f993616d451abcab7 Aug 10 17:19:41.540163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:19:41.540163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeShelveTestJSON-916578395-project Aug 10 17:19:41.540163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:19:41.540163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:19:41.540163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 5bf9229cd5d6429ea14249f8976e83cc Aug 10 17:19:41.540163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-916578395-project Aug 10 17:19:41.540163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:19:41.540163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:19:41.540163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': '1e46673f-6139-4b97-b57a-b65886eb16b1'} Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:19:41.540969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:19:41.542200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:19:41.543327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-948e0f29-0777-4c28-91ef-59630612729a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Returning 404 to user: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:19:41.543327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-948e0f29-0777-4c28-91ef-59630612729a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 404 len: 111 microversion: 2.20 time: 0.031681 Aug 10 17:19:41.543327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 376/746] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:41 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:19:41.549850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-61290e1a-eb60-41d5-ace9-61b69a010148 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '.version_select at 0x7f7eb9f01d30>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:41.632097 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-61290e1a-eb60-41d5-ace9-61b69a010148 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314704727" status: 204 len: 0 microversion: 2.20 time: 0.086463 Aug 10 17:19:41.641122 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 371/747] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Aug 10 17:19:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314704727 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:19:41.913650 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f844ace9-bdb0-4378-8aec-c6208b940ad2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Action: 'create', calling method: .version_select at 0x7f7eb9e98b80>, body: {"keypair": {"name": "tempest-keypair-518112755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMyAYqclO8E5GA1UBqOmnyE5PdZ8E8Dl7y6j+APHmSzleSY7SZi2o2D9zvObrPOxYBTbap1eF+bG/0W4qP+7nKy3CV4CVKtYv5c4fuoIvv/9cnukV1XY3b7FBlYsB0Tlg=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:41.932887 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-f844ace9-bdb0-4378-8aec-c6208b940ad2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Getting quotas for project 7e92e1e1c27241798e336e547580be5e. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:19:41.938448 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-f844ace9-bdb0-4378-8aec-c6208b940ad2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Getting quotas for user 2f74a20789dc4ef697861146252bacba and project 7e92e1e1c27241798e336e547580be5e. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:19:42.043453 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f844ace9-bdb0-4378-8aec-c6208b940ad2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.134544 Aug 10 17:19:42.044058 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 377/748] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 17:19:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:19:42.497338 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6998b1f9-84c8-4d21-adb4-939703350e63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Action: 'create', calling method: .version_select at 0x7f7eb9e74ca0>, body: {"keypair": {"name": "tempest-keypair-350121916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+QlUBDr1K0XT3Bu9hm1HPMcXMN6xozBocf2rVAOjqc0HOuByjESxWAs6qYHS6CWn8J/ESr8Jw9VUVC8l3GYSgMnR2CMSZXoEZir1iYTY8iE7+SwP2nn0tgPhi3JBFGbg=="}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:42.515473 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-6998b1f9-84c8-4d21-adb4-939703350e63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Getting quotas for project ed45fd312c58480f993616d451abcab7. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:19:42.519372 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-6998b1f9-84c8-4d21-adb4-939703350e63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Getting quotas for user 5bf9229cd5d6429ea14249f8976e83cc and project ed45fd312c58480f993616d451abcab7. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:19:42.659733 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6998b1f9-84c8-4d21-adb4-939703350e63 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.166812 Aug 10 17:19:42.660341 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 372/749] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Aug 10 17:19:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 168 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 10 17:19:45.311307 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1246995921", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa424745-59e7-4688-a728-8cee87fc07ca"}], "security_groups": [{"name": "tempest-securitygroup--1091187213"}], "key_name": "tempest-keypair-518112755", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:45.418053 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] validate_networks() for [('aa424745-59e7-4688-a728-8cee87fc07ca', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:19:45.900661 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:19:45.901109 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:19:45.901686 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:19:45.902111 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:19:45.902584 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:19:45.911269 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:45.912045 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:45.912697 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:45.913434 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:45.913892 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:45.914440 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:45.931638 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Getting quotas for project 7e92e1e1c27241798e336e547580be5e. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:19:45.935657 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Getting quotas for user 2f74a20789dc4ef697861146252bacba and project 7e92e1e1c27241798e336e547580be5e. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:19:45.948133 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:19:45.950447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:19:45.965175 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1523672922", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c304dfa-d435-4428-99f4-91e05a894449"}], "security_groups": [{"name": "tempest-securitygroup--609598507"}], "key_name": "tempest-keypair-350121916", "user_data": "}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:46.068130 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] validate_networks() for [('3c304dfa-d435-4428-99f4-91e05a894449', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:19:46.102956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-14e243dd-dd8b-493b-9dc2-65267541722e tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.796416 Aug 10 17:19:46.103906 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 378/750] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:19:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:19:46.114899 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-76ee104b-d2a7-47c9-9cb7-61959db2d8e6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:46.115594 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-76ee104b-d2a7-47c9-9cb7-61959db2d8e6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:46.189272 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-76ee104b-d2a7-47c9-9cb7-61959db2d8e6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:46.197705 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-76ee104b-d2a7-47c9-9cb7-61959db2d8e6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1237 microversion: 2.1 time: 0.086680 Aug 10 17:19:46.198390 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 379/751] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:46 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:46.529282 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:19:46.529705 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:19:46.530182 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:19:46.530653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:19:46.531143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:19:46.540439 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:46.540916 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:46.541346 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:46.542065 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:46.542638 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:46.543036 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:46.560098 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Getting quotas for project ed45fd312c58480f993616d451abcab7. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:19:46.564176 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Getting quotas for user 5bf9229cd5d6429ea14249f8976e83cc and project ed45fd312c58480f993616d451abcab7. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:19:46.586177 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:19:46.586177 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:19:46.701556 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4a52cf28-df3f-4880-bc64-dc6baf34fd0e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.741716 Aug 10 17:19:46.702194 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 373/752] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Aug 10 17:19:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 10 17:19:46.713498 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ea38ba6a-93c4-4c42-99f3-723abd38f80c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:46.714162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ea38ba6a-93c4-4c42-99f3-723abd38f80c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:46.787283 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ea38ba6a-93c4-4c42-99f3-723abd38f80c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:46.797342 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ea38ba6a-93c4-4c42-99f3-723abd38f80c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:46.798938 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ea38ba6a-93c4-4c42-99f3-723abd38f80c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:46.800342 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ea38ba6a-93c4-4c42-99f3-723abd38f80c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1281 microversion: 2.20 time: 0.091261 Aug 10 17:19:46.801070 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 380/753] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:46 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:47.219588 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a258465b-6d16-4777-97b3-716435ed2f14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:47.220205 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a258465b-6d16-4777-97b3-716435ed2f14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:47.227976 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a258465b-6d16-4777-97b3-716435ed2f14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:47.228468 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a258465b-6d16-4777-97b3-716435ed2f14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:47.228900 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a258465b-6d16-4777-97b3-716435ed2f14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:47.229601 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a258465b-6d16-4777-97b3-716435ed2f14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:47.230052 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a258465b-6d16-4777-97b3-716435ed2f14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:47.230509 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a258465b-6d16-4777-97b3-716435ed2f14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:47.530849 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a258465b-6d16-4777-97b3-716435ed2f14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:47.538982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a258465b-6d16-4777-97b3-716435ed2f14 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1241 microversion: 2.1 time: 0.323186 Aug 10 17:19:47.539822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 374/754] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:47 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1241 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:47.824202 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d548271c-f09d-4717-a99f-93bbcdd543a4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:47.824824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d548271c-f09d-4717-a99f-93bbcdd543a4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:47.831892 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d548271c-f09d-4717-a99f-93bbcdd543a4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:47.839473 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d548271c-f09d-4717-a99f-93bbcdd543a4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:47.839473 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d548271c-f09d-4717-a99f-93bbcdd543a4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:47.839473 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d548271c-f09d-4717-a99f-93bbcdd543a4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:47.839473 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d548271c-f09d-4717-a99f-93bbcdd543a4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:47.839866 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d548271c-f09d-4717-a99f-93bbcdd543a4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:47.898944 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d548271c-f09d-4717-a99f-93bbcdd543a4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:47.907108 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d548271c-f09d-4717-a99f-93bbcdd543a4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:47.908616 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d548271c-f09d-4717-a99f-93bbcdd543a4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:47.909763 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d548271c-f09d-4717-a99f-93bbcdd543a4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1285 microversion: 2.20 time: 0.089972 Aug 10 17:19:47.910326 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 381/755] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:47 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:48.560063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-08a3d2f4-0bd6-40e2-a63f-1fc3804c96aa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:48.560682 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-08a3d2f4-0bd6-40e2-a63f-1fc3804c96aa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:48.567577 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08a3d2f4-0bd6-40e2-a63f-1fc3804c96aa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:48.568077 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08a3d2f4-0bd6-40e2-a63f-1fc3804c96aa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:48.568519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08a3d2f4-0bd6-40e2-a63f-1fc3804c96aa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:48.574670 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08a3d2f4-0bd6-40e2-a63f-1fc3804c96aa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:48.574670 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08a3d2f4-0bd6-40e2-a63f-1fc3804c96aa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:48.574670 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08a3d2f4-0bd6-40e2-a63f-1fc3804c96aa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:48.635471 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-08a3d2f4-0bd6-40e2-a63f-1fc3804c96aa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:48.642801 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-08a3d2f4-0bd6-40e2-a63f-1fc3804c96aa tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1289 microversion: 2.1 time: 0.086647 Aug 10 17:19:48.643369 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 375/756] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:48 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:48.933966 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5f5d21fd-93c6-420f-b81e-093e8bae7c7d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:48.934605 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5f5d21fd-93c6-420f-b81e-093e8bae7c7d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:48.940973 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f5d21fd-93c6-420f-b81e-093e8bae7c7d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:48.941457 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f5d21fd-93c6-420f-b81e-093e8bae7c7d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:48.941898 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f5d21fd-93c6-420f-b81e-093e8bae7c7d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:48.942684 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f5d21fd-93c6-420f-b81e-093e8bae7c7d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:48.943155 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f5d21fd-93c6-420f-b81e-093e8bae7c7d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:48.943583 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f5d21fd-93c6-420f-b81e-093e8bae7c7d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:49.014717 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5f5d21fd-93c6-420f-b81e-093e8bae7c7d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:49.022748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5f5d21fd-93c6-420f-b81e-093e8bae7c7d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:49.024665 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5f5d21fd-93c6-420f-b81e-093e8bae7c7d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:49.025781 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5f5d21fd-93c6-420f-b81e-093e8bae7c7d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1333 microversion: 2.20 time: 0.096430 Aug 10 17:19:49.026448 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 382/757] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:48 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:49.668354 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b73844b8-c0f7-4f3b-bcc9-d20ecdd832a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:49.670527 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b73844b8-c0f7-4f3b-bcc9-d20ecdd832a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:49.682029 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b73844b8-c0f7-4f3b-bcc9-d20ecdd832a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:49.682939 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b73844b8-c0f7-4f3b-bcc9-d20ecdd832a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:49.683955 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b73844b8-c0f7-4f3b-bcc9-d20ecdd832a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:49.684899 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b73844b8-c0f7-4f3b-bcc9-d20ecdd832a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:49.685588 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b73844b8-c0f7-4f3b-bcc9-d20ecdd832a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:49.686433 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b73844b8-c0f7-4f3b-bcc9-d20ecdd832a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:49.753261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b73844b8-c0f7-4f3b-bcc9-d20ecdd832a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:49.762475 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b73844b8-c0f7-4f3b-bcc9-d20ecdd832a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1295 microversion: 2.1 time: 0.101944 Aug 10 17:19:49.763146 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 376/758] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:49 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1295 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:50.048436 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-64f6a39c-6c71-4c2d-8978-0b2570022430 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:50.049090 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-64f6a39c-6c71-4c2d-8978-0b2570022430 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:50.056193 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64f6a39c-6c71-4c2d-8978-0b2570022430 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:50.056686 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64f6a39c-6c71-4c2d-8978-0b2570022430 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:50.057128 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64f6a39c-6c71-4c2d-8978-0b2570022430 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:50.057832 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64f6a39c-6c71-4c2d-8978-0b2570022430 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:50.058294 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64f6a39c-6c71-4c2d-8978-0b2570022430 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:50.058754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64f6a39c-6c71-4c2d-8978-0b2570022430 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:50.122647 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-64f6a39c-6c71-4c2d-8978-0b2570022430 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:50.125154 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:50.132597 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-64f6a39c-6c71-4c2d-8978-0b2570022430 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:50.135149 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-64f6a39c-6c71-4c2d-8978-0b2570022430 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:50.136560 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-64f6a39c-6c71-4c2d-8978-0b2570022430 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1351 microversion: 2.20 time: 0.091847 Aug 10 17:19:50.137191 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 383/759] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:50 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:50.784669 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b7d55f82-fbc0-43f8-947e-407c30f742f8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:50.785294 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b7d55f82-fbc0-43f8-947e-407c30f742f8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:50.792880 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7d55f82-fbc0-43f8-947e-407c30f742f8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:50.793381 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7d55f82-fbc0-43f8-947e-407c30f742f8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:50.793821 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7d55f82-fbc0-43f8-947e-407c30f742f8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:50.794736 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7d55f82-fbc0-43f8-947e-407c30f742f8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:50.795358 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7d55f82-fbc0-43f8-947e-407c30f742f8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:50.795955 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7d55f82-fbc0-43f8-947e-407c30f742f8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:50.948819 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b7d55f82-fbc0-43f8-947e-407c30f742f8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:50.952006 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b7d55f82-fbc0-43f8-947e-407c30f742f8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1363 microversion: 2.1 time: 0.170999 Aug 10 17:19:50.952601 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 377/760] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:50 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:51.159340 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f9905a78-b9e7-4b40-9449-83e95715d213 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:51.159926 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f9905a78-b9e7-4b40-9449-83e95715d213 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:51.166811 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9905a78-b9e7-4b40-9449-83e95715d213 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:51.167298 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9905a78-b9e7-4b40-9449-83e95715d213 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:51.167760 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9905a78-b9e7-4b40-9449-83e95715d213 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:51.168447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9905a78-b9e7-4b40-9449-83e95715d213 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:51.169008 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9905a78-b9e7-4b40-9449-83e95715d213 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:51.169432 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9905a78-b9e7-4b40-9449-83e95715d213 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:51.313369 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f9905a78-b9e7-4b40-9449-83e95715d213 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:51.325842 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f9905a78-b9e7-4b40-9449-83e95715d213 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:51.327482 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f9905a78-b9e7-4b40-9449-83e95715d213 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:51.328772 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f9905a78-b9e7-4b40-9449-83e95715d213 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1406 microversion: 2.20 time: 0.173180 Aug 10 17:19:51.329346 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 384/761] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:51 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:51.905588 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-55d1402b-0f0a-4f25-a9c6-100a3a6083a9 req-3dd26159-58ee-4d69-a840-fb5533b9f3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f39ecbc-070d-4ad9-9ac3-3bb23fe51438", "tag": "380440cb-8fb3-4cef-9587-9e46611a7ec1"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:51.915977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-55d1402b-0f0a-4f25-a9c6-100a3a6083a9 req-3dd26159-58ee-4d69-a840-fb5533b9f3e3 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:51.916552 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-55d1402b-0f0a-4f25-a9c6-100a3a6083a9 req-3dd26159-58ee-4d69-a840-fb5533b9f3e3 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:51.917003 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-55d1402b-0f0a-4f25-a9c6-100a3a6083a9 req-3dd26159-58ee-4d69-a840-fb5533b9f3e3 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:51.929012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-55d1402b-0f0a-4f25-a9c6-100a3a6083a9 req-3dd26159-58ee-4d69-a840-fb5533b9f3e3 service nova] Creating event network-changed:380440cb-8fb3-4cef-9587-9e46611a7ec1 for instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 on hv-cinder-85272 Aug 10 17:19:51.934317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-55d1402b-0f0a-4f25-a9c6-100a3a6083a9 req-3dd26159-58ee-4d69-a840-fb5533b9f3e3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158630 Aug 10 17:19:51.935154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 378/762] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:19:51.973329 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9354eb66-0d34-45cd-afd7-805f9ecd4d07 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:51.974069 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9354eb66-0d34-45cd-afd7-805f9ecd4d07 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:51.980741 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9354eb66-0d34-45cd-afd7-805f9ecd4d07 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:51.981303 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9354eb66-0d34-45cd-afd7-805f9ecd4d07 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:51.981757 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9354eb66-0d34-45cd-afd7-805f9ecd4d07 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:51.991423 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9354eb66-0d34-45cd-afd7-805f9ecd4d07 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:51.991423 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9354eb66-0d34-45cd-afd7-805f9ecd4d07 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:51.991423 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9354eb66-0d34-45cd-afd7-805f9ecd4d07 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:52.117900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9354eb66-0d34-45cd-afd7-805f9ecd4d07 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:52.125728 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9354eb66-0d34-45cd-afd7-805f9ecd4d07 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1363 microversion: 2.1 time: 0.156161 Aug 10 17:19:52.126307 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 385/763] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:51 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:52.353166 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f2f14222-6703-495d-8398-704e065a1239 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:52.354165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f2f14222-6703-495d-8398-704e065a1239 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:52.361000 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2f14222-6703-495d-8398-704e065a1239 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:52.361634 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2f14222-6703-495d-8398-704e065a1239 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:52.362322 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2f14222-6703-495d-8398-704e065a1239 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:52.363256 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2f14222-6703-495d-8398-704e065a1239 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:52.363789 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2f14222-6703-495d-8398-704e065a1239 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:52.364376 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2f14222-6703-495d-8398-704e065a1239 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:52.536913 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f2f14222-6703-495d-8398-704e065a1239 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:52.545149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f2f14222-6703-495d-8398-704e065a1239 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:52.546684 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f2f14222-6703-495d-8398-704e065a1239 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:52.547811 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f2f14222-6703-495d-8398-704e065a1239 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1406 microversion: 2.20 time: 0.199251 Aug 10 17:19:52.548566 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 379/764] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:52 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:52.627074 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5ffff03e-6d37-4dad-8959-592199b9ab87 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:52.627640 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5ffff03e-6d37-4dad-8959-592199b9ab87 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:52.644144 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ffff03e-6d37-4dad-8959-592199b9ab87 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:52.644144 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ffff03e-6d37-4dad-8959-592199b9ab87 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:52.644144 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ffff03e-6d37-4dad-8959-592199b9ab87 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:52.644144 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ffff03e-6d37-4dad-8959-592199b9ab87 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:52.644553 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ffff03e-6d37-4dad-8959-592199b9ab87 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:52.644553 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ffff03e-6d37-4dad-8959-592199b9ab87 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:52.718886 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-5ffff03e-6d37-4dad-8959-592199b9ab87 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lazy-loading 'services' on Instance uuid 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:19:52.933956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5ffff03e-6d37-4dad-8959-592199b9ab87 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "DELETE /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments/3210059d-735c-485a-a95d-34138d4f7c6f" status: 202 len: 0 microversion: 2.1 time: 0.312334 Aug 10 17:19:52.934575 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 386/765] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 17:19:52 2022] DELETE /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments/3210059d-735c-485a-a95d-34138d4f7c6f => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:19:52.943048 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4d160e5b-d154-477e-8b1f-e8083377ebe6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:52.945311 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4d160e5b-d154-477e-8b1f-e8083377ebe6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:52.951417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4d160e5b-d154-477e-8b1f-e8083377ebe6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:52.951908 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4d160e5b-d154-477e-8b1f-e8083377ebe6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:52.952343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4d160e5b-d154-477e-8b1f-e8083377ebe6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:52.953037 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4d160e5b-d154-477e-8b1f-e8083377ebe6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:52.953499 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4d160e5b-d154-477e-8b1f-e8083377ebe6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:52.953970 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4d160e5b-d154-477e-8b1f-e8083377ebe6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:52.983997 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4d160e5b-d154-477e-8b1f-e8083377ebe6 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044864 Aug 10 17:19:52.984475 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 380/766] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:19:52 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:19:53.114297 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-17c16a20-4f98-48cf-b6d5-44f315b5e0f8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:53.114920 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-17c16a20-4f98-48cf-b6d5-44f315b5e0f8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:53.121119 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17c16a20-4f98-48cf-b6d5-44f315b5e0f8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:53.121605 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17c16a20-4f98-48cf-b6d5-44f315b5e0f8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:53.122074 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17c16a20-4f98-48cf-b6d5-44f315b5e0f8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:53.122798 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17c16a20-4f98-48cf-b6d5-44f315b5e0f8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:53.123256 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17c16a20-4f98-48cf-b6d5-44f315b5e0f8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:53.123687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17c16a20-4f98-48cf-b6d5-44f315b5e0f8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:53.147157 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-17c16a20-4f98-48cf-b6d5-44f315b5e0f8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/ips" status: 200 len: 149 microversion: 2.1 time: 0.137842 Aug 10 17:19:53.147893 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 387/767] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 17:19:53 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/ips => generated 149 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:19:53.148067 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-367f0987-a7fa-4d80-b914-9c394100a975 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:53.149154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-367f0987-a7fa-4d80-b914-9c394100a975 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:53.155296 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-367f0987-a7fa-4d80-b914-9c394100a975 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:53.155888 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-367f0987-a7fa-4d80-b914-9c394100a975 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:53.156266 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-367f0987-a7fa-4d80-b914-9c394100a975 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:53.157069 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-367f0987-a7fa-4d80-b914-9c394100a975 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:53.157550 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-367f0987-a7fa-4d80-b914-9c394100a975 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:53.157981 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-367f0987-a7fa-4d80-b914-9c394100a975 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:53.291865 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-367f0987-a7fa-4d80-b914-9c394100a975 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:53.299238 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-367f0987-a7fa-4d80-b914-9c394100a975 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1363 microversion: 2.1 time: 0.155288 Aug 10 17:19:53.299806 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 381/768] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:53 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:19:53.571991 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-35fba518-5121-45cf-884b-f3f3d0dd18db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:53.572634 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-35fba518-5121-45cf-884b-f3f3d0dd18db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:53.578724 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35fba518-5121-45cf-884b-f3f3d0dd18db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:53.579212 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35fba518-5121-45cf-884b-f3f3d0dd18db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:53.579652 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35fba518-5121-45cf-884b-f3f3d0dd18db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:53.580350 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35fba518-5121-45cf-884b-f3f3d0dd18db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:53.580804 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35fba518-5121-45cf-884b-f3f3d0dd18db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:53.581231 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35fba518-5121-45cf-884b-f3f3d0dd18db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:53.732309 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-35fba518-5121-45cf-884b-f3f3d0dd18db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:53.741900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-35fba518-5121-45cf-884b-f3f3d0dd18db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:53.744406 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-35fba518-5121-45cf-884b-f3f3d0dd18db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:53.745646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-35fba518-5121-45cf-884b-f3f3d0dd18db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1406 microversion: 2.20 time: 0.178175 Aug 10 17:19:53.746624 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 388/769] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:53 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:53.975918 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-08ffb4e4-c022-4a3d-9d86-db47cf4d384b req-615adad4-de89-48f8-99cb-ccbbf2cb8853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7eaaa8-2f20-4c87-a62a-e855728effb1", "tag": "d08afacf-c192-4763-9246-60f0a09579d4"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:53.987829 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-08ffb4e4-c022-4a3d-9d86-db47cf4d384b req-615adad4-de89-48f8-99cb-ccbbf2cb8853 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:53.988021 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-08ffb4e4-c022-4a3d-9d86-db47cf4d384b req-615adad4-de89-48f8-99cb-ccbbf2cb8853 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:53.988427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-08ffb4e4-c022-4a3d-9d86-db47cf4d384b req-615adad4-de89-48f8-99cb-ccbbf2cb8853 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:53.998071 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0b48a5cf-4066-46dc-b8a6-8d87e2b34225 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:54.003084 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-08ffb4e4-c022-4a3d-9d86-db47cf4d384b req-615adad4-de89-48f8-99cb-ccbbf2cb8853 service nova] Creating event network-changed:d08afacf-c192-4763-9246-60f0a09579d4 for instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 on hv-cinder-85272 Aug 10 17:19:54.003215 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0b48a5cf-4066-46dc-b8a6-8d87e2b34225 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:54.004619 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-08ffb4e4-c022-4a3d-9d86-db47cf4d384b req-615adad4-de89-48f8-99cb-ccbbf2cb8853 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034829 Aug 10 17:19:54.005604 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 382/770] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:19:54.007902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0b48a5cf-4066-46dc-b8a6-8d87e2b34225 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:54.008398 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0b48a5cf-4066-46dc-b8a6-8d87e2b34225 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:54.009161 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0b48a5cf-4066-46dc-b8a6-8d87e2b34225 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:54.009819 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0b48a5cf-4066-46dc-b8a6-8d87e2b34225 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:54.010275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0b48a5cf-4066-46dc-b8a6-8d87e2b34225 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:54.010785 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0b48a5cf-4066-46dc-b8a6-8d87e2b34225 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:54.041764 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0b48a5cf-4066-46dc-b8a6-8d87e2b34225 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047749 Aug 10 17:19:54.042410 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 389/771] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:19:53 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:19:54.319856 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f4a6fb1f-7c81-4c20-8e32-21c81b0fc41a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:54.321089 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f4a6fb1f-7c81-4c20-8e32-21c81b0fc41a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:54.327701 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f4a6fb1f-7c81-4c20-8e32-21c81b0fc41a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:54.328224 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f4a6fb1f-7c81-4c20-8e32-21c81b0fc41a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:54.328670 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f4a6fb1f-7c81-4c20-8e32-21c81b0fc41a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:54.329363 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f4a6fb1f-7c81-4c20-8e32-21c81b0fc41a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:54.329816 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f4a6fb1f-7c81-4c20-8e32-21c81b0fc41a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:54.330241 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f4a6fb1f-7c81-4c20-8e32-21c81b0fc41a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:54.475673 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f4a6fb1f-7c81-4c20-8e32-21c81b0fc41a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:54.483500 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f4a6fb1f-7c81-4c20-8e32-21c81b0fc41a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1363 microversion: 2.1 time: 0.167812 Aug 10 17:19:54.484072 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 383/772] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:54 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:54.769123 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ef8373fe-6b2c-44fd-82e4-7b46a3ad30be tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:54.769883 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ef8373fe-6b2c-44fd-82e4-7b46a3ad30be tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:54.776877 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ef8373fe-6b2c-44fd-82e4-7b46a3ad30be tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:54.777365 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ef8373fe-6b2c-44fd-82e4-7b46a3ad30be tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:54.777806 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ef8373fe-6b2c-44fd-82e4-7b46a3ad30be tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:54.778544 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ef8373fe-6b2c-44fd-82e4-7b46a3ad30be tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:54.779006 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ef8373fe-6b2c-44fd-82e4-7b46a3ad30be tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:54.779435 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ef8373fe-6b2c-44fd-82e4-7b46a3ad30be tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:54.811710 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c4e8d350-e8a2-4661-babe-1ffac9762ce5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64a961b1-3232-4f0c-9ea0-c5c239e9c1b3"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:54.813998 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c4e8d350-e8a2-4661-babe-1ffac9762ce5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:54.820035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4e8d350-e8a2-4661-babe-1ffac9762ce5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:54.821258 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4e8d350-e8a2-4661-babe-1ffac9762ce5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:54.821693 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4e8d350-e8a2-4661-babe-1ffac9762ce5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:54.822404 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4e8d350-e8a2-4661-babe-1ffac9762ce5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:54.822860 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4e8d350-e8a2-4661-babe-1ffac9762ce5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:54.823279 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4e8d350-e8a2-4661-babe-1ffac9762ce5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:54.913206 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ef8373fe-6b2c-44fd-82e4-7b46a3ad30be tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:54.921784 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ef8373fe-6b2c-44fd-82e4-7b46a3ad30be tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:54.923306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ef8373fe-6b2c-44fd-82e4-7b46a3ad30be tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:54.924432 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ef8373fe-6b2c-44fd-82e4-7b46a3ad30be tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1406 microversion: 2.20 time: 0.159202 Aug 10 17:19:54.924989 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 390/773] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:54 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:55.053930 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7c348e31-ecce-4e69-ab19-cbf51780d9df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:55.056866 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7c348e31-ecce-4e69-ab19-cbf51780d9df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:55.062933 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7c348e31-ecce-4e69-ab19-cbf51780d9df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:55.063422 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7c348e31-ecce-4e69-ab19-cbf51780d9df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:55.063865 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7c348e31-ecce-4e69-ab19-cbf51780d9df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:55.064559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7c348e31-ecce-4e69-ab19-cbf51780d9df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:55.065016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7c348e31-ecce-4e69-ab19-cbf51780d9df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:55.065447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7c348e31-ecce-4e69-ab19-cbf51780d9df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:55.093913 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7c348e31-ecce-4e69-ab19-cbf51780d9df tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 Aug 10 17:19:55.094487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 391/774] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:19:55 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:19:55.505131 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-042f6f5d-b8fd-471e-b80d-db6a210b3c7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:55.506459 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-042f6f5d-b8fd-471e-b80d-db6a210b3c7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:55.513884 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-042f6f5d-b8fd-471e-b80d-db6a210b3c7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:55.514490 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-042f6f5d-b8fd-471e-b80d-db6a210b3c7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:55.522221 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-042f6f5d-b8fd-471e-b80d-db6a210b3c7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:55.522221 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-042f6f5d-b8fd-471e-b80d-db6a210b3c7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:55.522221 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-042f6f5d-b8fd-471e-b80d-db6a210b3c7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:55.522221 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-042f6f5d-b8fd-471e-b80d-db6a210b3c7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:55.522746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:55.659914 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-042f6f5d-b8fd-471e-b80d-db6a210b3c7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:55.669021 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-042f6f5d-b8fd-471e-b80d-db6a210b3c7a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1363 microversion: 2.1 time: 0.167937 Aug 10 17:19:55.669708 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 392/775] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:55 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:19:55.950620 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2b5dd1ca-151c-4ac5-92bf-7770da3c994b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:55.952085 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2b5dd1ca-151c-4ac5-92bf-7770da3c994b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:55.955712 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:55.964867 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b5dd1ca-151c-4ac5-92bf-7770da3c994b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:55.965268 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b5dd1ca-151c-4ac5-92bf-7770da3c994b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:55.965831 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b5dd1ca-151c-4ac5-92bf-7770da3c994b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:55.966714 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b5dd1ca-151c-4ac5-92bf-7770da3c994b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:55.968704 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b5dd1ca-151c-4ac5-92bf-7770da3c994b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:55.968704 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b5dd1ca-151c-4ac5-92bf-7770da3c994b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:56.107012 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2b5dd1ca-151c-4ac5-92bf-7770da3c994b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:56.115281 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2b5dd1ca-151c-4ac5-92bf-7770da3c994b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:56.116786 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2b5dd1ca-151c-4ac5-92bf-7770da3c994b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:56.118434 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2b5dd1ca-151c-4ac5-92bf-7770da3c994b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1406 microversion: 2.20 time: 0.174693 Aug 10 17:19:56.118993 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 393/776] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:55 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:19:56.123655 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ca02f9ba-2e36-4687-8c5f-eb6827897457 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:56.125821 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ca02f9ba-2e36-4687-8c5f-eb6827897457 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:56.132136 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca02f9ba-2e36-4687-8c5f-eb6827897457 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:56.132680 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca02f9ba-2e36-4687-8c5f-eb6827897457 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:56.134270 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca02f9ba-2e36-4687-8c5f-eb6827897457 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:56.135147 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca02f9ba-2e36-4687-8c5f-eb6827897457 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:56.135621 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca02f9ba-2e36-4687-8c5f-eb6827897457 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:56.136066 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca02f9ba-2e36-4687-8c5f-eb6827897457 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:56.165348 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ca02f9ba-2e36-4687-8c5f-eb6827897457 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044424 Aug 10 17:19:56.168947 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 394/777] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:19:56 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:19:56.246725 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d6a1dce6-9358-4602-910a-899bb16d11e1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:56.247219 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d6a1dce6-9358-4602-910a-899bb16d11e1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:56.253514 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6a1dce6-9358-4602-910a-899bb16d11e1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:56.253992 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6a1dce6-9358-4602-910a-899bb16d11e1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:56.254472 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6a1dce6-9358-4602-910a-899bb16d11e1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:56.255157 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6a1dce6-9358-4602-910a-899bb16d11e1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:56.255760 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6a1dce6-9358-4602-910a-899bb16d11e1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:56.256065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6a1dce6-9358-4602-910a-899bb16d11e1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:56.281488 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d6a1dce6-9358-4602-910a-899bb16d11e1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:19:56.438935 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c4e8d350-e8a2-4661-babe-1ffac9762ce5 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "POST /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.630888 Aug 10 17:19:56.439554 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 384/778] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 17:19:54 2022] POST /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments => generated 194 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:19:56.608687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d6a1dce6-9358-4602-910a-899bb16d11e1 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "DELETE /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 204 len: 0 microversion: 2.1 time: 0.366162 Aug 10 17:19:56.613047 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 395/779] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:19:56 2022] DELETE /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:19:56.615551 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:56.620726 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=10 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:56.621060 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9f7e7956-cc4c-41c7-9259-11959a55091a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:56.621770 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9f7e7956-cc4c-41c7-9259-11959a55091a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:56.623656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:56.629413 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f7e7956-cc4c-41c7-9259-11959a55091a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:56.630093 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f7e7956-cc4c-41c7-9259-11959a55091a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:56.630423 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f7e7956-cc4c-41c7-9259-11959a55091a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:56.631153 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f7e7956-cc4c-41c7-9259-11959a55091a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:56.631606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f7e7956-cc4c-41c7-9259-11959a55091a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:56.632025 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9f7e7956-cc4c-41c7-9259-11959a55091a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:56.690869 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a6ca4de1-82aa-4863-afae-9044ea4780a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:56.691863 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a6ca4de1-82aa-4863-afae-9044ea4780a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:56.698553 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6ca4de1-82aa-4863-afae-9044ea4780a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:56.699820 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6ca4de1-82aa-4863-afae-9044ea4780a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:56.699820 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6ca4de1-82aa-4863-afae-9044ea4780a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:56.700357 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6ca4de1-82aa-4863-afae-9044ea4780a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:56.700853 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6ca4de1-82aa-4863-afae-9044ea4780a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:56.701284 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6ca4de1-82aa-4863-afae-9044ea4780a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:56.794299 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=14 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:56.806510 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9f7e7956-cc4c-41c7-9259-11959a55091a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:56.814684 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9f7e7956-cc4c-41c7-9259-11959a55091a tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1688 microversion: 2.1 time: 0.200428 Aug 10 17:19:56.821401 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 385/780] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:56 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1688 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:56.867890 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a6ca4de1-82aa-4863-afae-9044ea4780a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:56.875281 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a6ca4de1-82aa-4863-afae-9044ea4780a6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1363 microversion: 2.1 time: 0.188996 Aug 10 17:19:56.875849 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 396/781] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:56 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:19:57.141900 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ca933854-824e-48fe-99f2-10df338bde1a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:57.142522 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ca933854-824e-48fe-99f2-10df338bde1a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:57.148481 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca933854-824e-48fe-99f2-10df338bde1a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:57.148965 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca933854-824e-48fe-99f2-10df338bde1a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:57.149392 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca933854-824e-48fe-99f2-10df338bde1a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:57.150074 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca933854-824e-48fe-99f2-10df338bde1a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:57.150546 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca933854-824e-48fe-99f2-10df338bde1a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:57.150964 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ca933854-824e-48fe-99f2-10df338bde1a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:57.281677 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ca933854-824e-48fe-99f2-10df338bde1a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:57.290491 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ca933854-824e-48fe-99f2-10df338bde1a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:57.292350 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ca933854-824e-48fe-99f2-10df338bde1a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:57.293486 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ca933854-824e-48fe-99f2-10df338bde1a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1406 microversion: 2.20 time: 0.155919 Aug 10 17:19:57.294045 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 386/782] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:57 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:57.837991 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-46d8547d-44c2-4028-841c-ff2b976b844e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:57.838697 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-46d8547d-44c2-4028-841c-ff2b976b844e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:57.841022 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:57.846419 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46d8547d-44c2-4028-841c-ff2b976b844e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:57.846906 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46d8547d-44c2-4028-841c-ff2b976b844e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:57.847398 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46d8547d-44c2-4028-841c-ff2b976b844e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:57.848087 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46d8547d-44c2-4028-841c-ff2b976b844e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:57.848546 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46d8547d-44c2-4028-841c-ff2b976b844e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:57.848973 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46d8547d-44c2-4028-841c-ff2b976b844e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:57.896656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9add6f2b-f775-4dd2-9e21-e5d9dc6d1af3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:57.897257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9add6f2b-f775-4dd2-9e21-e5d9dc6d1af3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:57.904275 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9add6f2b-f775-4dd2-9e21-e5d9dc6d1af3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:57.904756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9add6f2b-f775-4dd2-9e21-e5d9dc6d1af3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:57.905188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9add6f2b-f775-4dd2-9e21-e5d9dc6d1af3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:57.905875 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9add6f2b-f775-4dd2-9e21-e5d9dc6d1af3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:57.906324 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9add6f2b-f775-4dd2-9e21-e5d9dc6d1af3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:57.906781 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9add6f2b-f775-4dd2-9e21-e5d9dc6d1af3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:58.044412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-46d8547d-44c2-4028-841c-ff2b976b844e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:58.051935 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-46d8547d-44c2-4028-841c-ff2b976b844e tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1688 microversion: 2.1 time: 0.218802 Aug 10 17:19:58.052501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 397/783] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:57 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1688 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:58.066023 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9add6f2b-f775-4dd2-9e21-e5d9dc6d1af3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:58.073972 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9add6f2b-f775-4dd2-9e21-e5d9dc6d1af3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1363 microversion: 2.1 time: 0.181128 Aug 10 17:19:58.075477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 387/784] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:57 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:19:58.316987 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-87814ccd-788a-4a67-824c-5ccd1449d460 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:58.317507 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-87814ccd-788a-4a67-824c-5ccd1449d460 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:58.323987 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87814ccd-788a-4a67-824c-5ccd1449d460 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:58.324464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87814ccd-788a-4a67-824c-5ccd1449d460 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:58.324895 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87814ccd-788a-4a67-824c-5ccd1449d460 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:58.325582 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87814ccd-788a-4a67-824c-5ccd1449d460 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:58.326036 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87814ccd-788a-4a67-824c-5ccd1449d460 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:58.326479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87814ccd-788a-4a67-824c-5ccd1449d460 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:58.341392 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:19:58.464278 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-87814ccd-788a-4a67-824c-5ccd1449d460 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:58.472814 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-87814ccd-788a-4a67-824c-5ccd1449d460 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:58.474552 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-87814ccd-788a-4a67-824c-5ccd1449d460 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:58.475912 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-87814ccd-788a-4a67-824c-5ccd1449d460 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1406 microversion: 2.20 time: 0.162865 Aug 10 17:19:58.477486 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 398/785] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:58 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:19:58.950584 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-1b0bf767-33c4-42eb-8c52-e6f0d26f5794 req-06229099-e0a4-47a9-a28b-cbbe9bdf642a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f39ecbc-070d-4ad9-9ac3-3bb23fe51438", "name": "network-vif-plugged", "status": "completed", "tag": "380440cb-8fb3-4cef-9587-9e46611a7ec1"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:19:58.960862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-1b0bf767-33c4-42eb-8c52-e6f0d26f5794 req-06229099-e0a4-47a9-a28b-cbbe9bdf642a service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:58.961851 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-1b0bf767-33c4-42eb-8c52-e6f0d26f5794 req-06229099-e0a4-47a9-a28b-cbbe9bdf642a service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:58.962283 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-1b0bf767-33c4-42eb-8c52-e6f0d26f5794 req-06229099-e0a4-47a9-a28b-cbbe9bdf642a service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:58.973645 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-1b0bf767-33c4-42eb-8c52-e6f0d26f5794 req-06229099-e0a4-47a9-a28b-cbbe9bdf642a service nova] Creating event network-vif-plugged:380440cb-8fb3-4cef-9587-9e46611a7ec1 for instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 on hv-cinder-85272 Aug 10 17:19:58.978495 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-1b0bf767-33c4-42eb-8c52-e6f0d26f5794 req-06229099-e0a4-47a9-a28b-cbbe9bdf642a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031590 Aug 10 17:19:58.979100 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 388/786] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:19:59.073076 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-816c11e7-0851-4720-bbde-194e7f629ca0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:59.076205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-816c11e7-0851-4720-bbde-194e7f629ca0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:59.080375 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-816c11e7-0851-4720-bbde-194e7f629ca0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:59.080864 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-816c11e7-0851-4720-bbde-194e7f629ca0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:59.081304 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-816c11e7-0851-4720-bbde-194e7f629ca0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:59.082008 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-816c11e7-0851-4720-bbde-194e7f629ca0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:59.082493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-816c11e7-0851-4720-bbde-194e7f629ca0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:59.082925 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-816c11e7-0851-4720-bbde-194e7f629ca0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:59.095975 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6da19bc2-91bd-4eab-a85e-0afba6c281e5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:59.096755 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6da19bc2-91bd-4eab-a85e-0afba6c281e5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:59.103676 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6da19bc2-91bd-4eab-a85e-0afba6c281e5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:59.104161 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6da19bc2-91bd-4eab-a85e-0afba6c281e5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:59.104600 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6da19bc2-91bd-4eab-a85e-0afba6c281e5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:59.105373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6da19bc2-91bd-4eab-a85e-0afba6c281e5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:59.105830 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6da19bc2-91bd-4eab-a85e-0afba6c281e5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:59.106253 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6da19bc2-91bd-4eab-a85e-0afba6c281e5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:59.286655 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-816c11e7-0851-4720-bbde-194e7f629ca0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:59.293634 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6da19bc2-91bd-4eab-a85e-0afba6c281e5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:59.294566 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-816c11e7-0851-4720-bbde-194e7f629ca0 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1688 microversion: 2.1 time: 0.226321 Aug 10 17:19:59.295147 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 399/787] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:59 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1688 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:19:59.301348 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6da19bc2-91bd-4eab-a85e-0afba6c281e5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1363 microversion: 2.1 time: 0.209456 Aug 10 17:19:59.302002 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 389/788] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:19:59 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:19:59.499577 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e83a9fc2-8861-4053-84f2-0fbcf357f7e3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:19:59.500186 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e83a9fc2-8861-4053-84f2-0fbcf357f7e3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:19:59.506059 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e83a9fc2-8861-4053-84f2-0fbcf357f7e3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:59.506596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e83a9fc2-8861-4053-84f2-0fbcf357f7e3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:59.507036 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e83a9fc2-8861-4053-84f2-0fbcf357f7e3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:59.507945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e83a9fc2-8861-4053-84f2-0fbcf357f7e3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:19:59.508385 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e83a9fc2-8861-4053-84f2-0fbcf357f7e3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:19:59.509023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e83a9fc2-8861-4053-84f2-0fbcf357f7e3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:19:59.643544 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e83a9fc2-8861-4053-84f2-0fbcf357f7e3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:59.652330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e83a9fc2-8861-4053-84f2-0fbcf357f7e3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:59.653845 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e83a9fc2-8861-4053-84f2-0fbcf357f7e3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:19:59.654990 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e83a9fc2-8861-4053-84f2-0fbcf357f7e3 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1406 microversion: 2.20 time: 0.159282 Aug 10 17:19:59.655544 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 400/789] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:19:59 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:20:00.316131 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0c85c70f-7475-467e-9a45-4c89047471f2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:00.316830 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0c85c70f-7475-467e-9a45-4c89047471f2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:00.323798 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-863cc54f-9592-4f3a-a4d3-962d1e0418f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:00.324363 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0c85c70f-7475-467e-9a45-4c89047471f2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:00.324466 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-863cc54f-9592-4f3a-a4d3-962d1e0418f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:00.324710 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0c85c70f-7475-467e-9a45-4c89047471f2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:00.326697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0c85c70f-7475-467e-9a45-4c89047471f2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:00.327523 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0c85c70f-7475-467e-9a45-4c89047471f2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:00.328034 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0c85c70f-7475-467e-9a45-4c89047471f2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:00.328503 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0c85c70f-7475-467e-9a45-4c89047471f2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:00.331573 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-863cc54f-9592-4f3a-a4d3-962d1e0418f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:00.333438 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-863cc54f-9592-4f3a-a4d3-962d1e0418f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:00.333438 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-863cc54f-9592-4f3a-a4d3-962d1e0418f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:00.333438 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-863cc54f-9592-4f3a-a4d3-962d1e0418f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:00.334244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-863cc54f-9592-4f3a-a4d3-962d1e0418f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:00.334875 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-863cc54f-9592-4f3a-a4d3-962d1e0418f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:00.538979 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-863cc54f-9592-4f3a-a4d3-962d1e0418f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:00.542139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0c85c70f-7475-467e-9a45-4c89047471f2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:00.547447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-863cc54f-9592-4f3a-a4d3-962d1e0418f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1363 microversion: 2.1 time: 0.228613 Aug 10 17:20:00.548157 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 401/790] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:00 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:00.549962 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0c85c70f-7475-467e-9a45-4c89047471f2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1688 microversion: 2.1 time: 0.237803 Aug 10 17:20:00.550864 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 390/791] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:00 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1688 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:00.678034 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-383ced8b-c4d8-4304-b3c7-5db4632efc0a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:00.678895 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-383ced8b-c4d8-4304-b3c7-5db4632efc0a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:00.689822 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-383ced8b-c4d8-4304-b3c7-5db4632efc0a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:00.690371 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-383ced8b-c4d8-4304-b3c7-5db4632efc0a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:00.690908 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-383ced8b-c4d8-4304-b3c7-5db4632efc0a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:00.691701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-383ced8b-c4d8-4304-b3c7-5db4632efc0a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:00.692269 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-383ced8b-c4d8-4304-b3c7-5db4632efc0a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:00.692778 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-383ced8b-c4d8-4304-b3c7-5db4632efc0a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:00.861118 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-383ced8b-c4d8-4304-b3c7-5db4632efc0a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:00.870226 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-383ced8b-c4d8-4304-b3c7-5db4632efc0a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:00.871765 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-383ced8b-c4d8-4304-b3c7-5db4632efc0a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:00.872914 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-383ced8b-c4d8-4304-b3c7-5db4632efc0a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1406 microversion: 2.20 time: 0.199719 Aug 10 17:20:00.873856 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 402/792] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:00 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:20:01.005850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-6c752d84-61ca-4f88-b008-35e993454b6a req-9fdd63fe-6030-4629-ba0d-98330fa7cdd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7eaaa8-2f20-4c87-a62a-e855728effb1", "name": "network-vif-plugged", "status": "completed", "tag": "d08afacf-c192-4763-9246-60f0a09579d4"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:01.014679 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-81cceb07-65f5-44dd-9981-ddddc5cff6f3 req-2bf4767d-bef8-479a-8e0d-61eb9236d439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a02347-095c-4aa2-92b0-5bcdf5fce2a9", "name": "network-vif-deleted", "tag": "f75a7b46-ae6b-4d8e-bf2e-f099e435733a"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:01.020620 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-6c752d84-61ca-4f88-b008-35e993454b6a req-9fdd63fe-6030-4629-ba0d-98330fa7cdd5 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:01.021694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-6c752d84-61ca-4f88-b008-35e993454b6a req-9fdd63fe-6030-4629-ba0d-98330fa7cdd5 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:01.023539 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-6c752d84-61ca-4f88-b008-35e993454b6a req-9fdd63fe-6030-4629-ba0d-98330fa7cdd5 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:01.025155 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-81cceb07-65f5-44dd-9981-ddddc5cff6f3 req-2bf4767d-bef8-479a-8e0d-61eb9236d439 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:01.025876 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-81cceb07-65f5-44dd-9981-ddddc5cff6f3 req-2bf4767d-bef8-479a-8e0d-61eb9236d439 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:01.026521 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-81cceb07-65f5-44dd-9981-ddddc5cff6f3 req-2bf4767d-bef8-479a-8e0d-61eb9236d439 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:01.040229 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-81cceb07-65f5-44dd-9981-ddddc5cff6f3 req-2bf4767d-bef8-479a-8e0d-61eb9236d439 service nova] Creating event network-vif-deleted:f75a7b46-ae6b-4d8e-bf2e-f099e435733a for instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 on hv-cinder-85272 Aug 10 17:20:01.041269 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-6c752d84-61ca-4f88-b008-35e993454b6a req-9fdd63fe-6030-4629-ba0d-98330fa7cdd5 service nova] Creating event network-vif-plugged:d08afacf-c192-4763-9246-60f0a09579d4 for instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 on hv-cinder-85272 Aug 10 17:20:01.046118 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-81cceb07-65f5-44dd-9981-ddddc5cff6f3 req-2bf4767d-bef8-479a-8e0d-61eb9236d439 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035311 Aug 10 17:20:01.046997 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 403/793] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:01.051176 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-6c752d84-61ca-4f88-b008-35e993454b6a req-9fdd63fe-6030-4629-ba0d-98330fa7cdd5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048902 Aug 10 17:20:01.051791 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 391/794] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:01.571680 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d524029e-f3e6-4a28-909f-4f8cf498aba9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:01.572372 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d524029e-f3e6-4a28-909f-4f8cf498aba9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:01.573258 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b93391a8-42ae-4fce-838b-1f793a2ac7e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:01.574082 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b93391a8-42ae-4fce-838b-1f793a2ac7e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:01.579113 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d524029e-f3e6-4a28-909f-4f8cf498aba9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:01.579606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d524029e-f3e6-4a28-909f-4f8cf498aba9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:01.580036 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d524029e-f3e6-4a28-909f-4f8cf498aba9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:01.580731 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d524029e-f3e6-4a28-909f-4f8cf498aba9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:01.581385 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d524029e-f3e6-4a28-909f-4f8cf498aba9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:01.581513 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b93391a8-42ae-4fce-838b-1f793a2ac7e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:01.581974 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b93391a8-42ae-4fce-838b-1f793a2ac7e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:01.582104 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d524029e-f3e6-4a28-909f-4f8cf498aba9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:01.582473 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b93391a8-42ae-4fce-838b-1f793a2ac7e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:01.583181 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b93391a8-42ae-4fce-838b-1f793a2ac7e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:01.583643 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b93391a8-42ae-4fce-838b-1f793a2ac7e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:01.584077 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b93391a8-42ae-4fce-838b-1f793a2ac7e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:01.626816 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d524029e-f3e6-4a28-909f-4f8cf498aba9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:01.627305 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d524029e-f3e6-4a28-909f-4f8cf498aba9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:01.627741 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d524029e-f3e6-4a28-909f-4f8cf498aba9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:01.628198 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-d524029e-f3e6-4a28-909f-4f8cf498aba9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lazy-loading 'fault' on Instance uuid 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:20:01.692041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d524029e-f3e6-4a28-909f-4f8cf498aba9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:01.700429 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d524029e-f3e6-4a28-909f-4f8cf498aba9 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1334 microversion: 2.1 time: 0.133012 Aug 10 17:20:01.713020 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 392/795] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:01 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1334 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:01.770696 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b93391a8-42ae-4fce-838b-1f793a2ac7e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:01.779495 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b93391a8-42ae-4fce-838b-1f793a2ac7e3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1363 microversion: 2.1 time: 0.214178 Aug 10 17:20:01.780250 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 404/796] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:01 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:01.896116 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b91f84f9-5823-490b-8b2a-7b686a27450a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:01.896722 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b91f84f9-5823-490b-8b2a-7b686a27450a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:01.903926 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b91f84f9-5823-490b-8b2a-7b686a27450a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:01.904425 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b91f84f9-5823-490b-8b2a-7b686a27450a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:01.904896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b91f84f9-5823-490b-8b2a-7b686a27450a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:01.905608 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b91f84f9-5823-490b-8b2a-7b686a27450a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:01.906068 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b91f84f9-5823-490b-8b2a-7b686a27450a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:01.906541 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b91f84f9-5823-490b-8b2a-7b686a27450a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:02.059059 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b91f84f9-5823-490b-8b2a-7b686a27450a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:02.067952 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b91f84f9-5823-490b-8b2a-7b686a27450a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:02.069518 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b91f84f9-5823-490b-8b2a-7b686a27450a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:02.071315 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b91f84f9-5823-490b-8b2a-7b686a27450a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1406 microversion: 2.20 time: 0.179258 Aug 10 17:20:02.076152 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 393/797] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:01 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:20:02.721332 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1c6abcf0-d287-4453-82d6-176799f39946 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:02.721930 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1c6abcf0-d287-4453-82d6-176799f39946 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:02.728424 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c6abcf0-d287-4453-82d6-176799f39946 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:02.728902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c6abcf0-d287-4453-82d6-176799f39946 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:02.729377 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c6abcf0-d287-4453-82d6-176799f39946 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:02.730075 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c6abcf0-d287-4453-82d6-176799f39946 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:02.730556 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c6abcf0-d287-4453-82d6-176799f39946 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:02.730978 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c6abcf0-d287-4453-82d6-176799f39946 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:02.763352 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c6abcf0-d287-4453-82d6-176799f39946 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:02.763751 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c6abcf0-d287-4453-82d6-176799f39946 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:02.764211 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c6abcf0-d287-4453-82d6-176799f39946 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:02.764660 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-1c6abcf0-d287-4453-82d6-176799f39946 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lazy-loading 'fault' on Instance uuid 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:20:02.800753 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-35ff9ca5-336e-48ed-851d-1989d7c3a03a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:02.801480 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-35ff9ca5-336e-48ed-851d-1989d7c3a03a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:02.805795 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1c6abcf0-d287-4453-82d6-176799f39946 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:02.809599 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35ff9ca5-336e-48ed-851d-1989d7c3a03a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:02.810093 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35ff9ca5-336e-48ed-851d-1989d7c3a03a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:02.810567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35ff9ca5-336e-48ed-851d-1989d7c3a03a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:02.811272 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35ff9ca5-336e-48ed-851d-1989d7c3a03a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:02.811756 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35ff9ca5-336e-48ed-851d-1989d7c3a03a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:02.812178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35ff9ca5-336e-48ed-851d-1989d7c3a03a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:02.813538 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1c6abcf0-d287-4453-82d6-176799f39946 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1334 microversion: 2.1 time: 0.096044 Aug 10 17:20:02.814120 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 405/798] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:02 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:02.946558 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-35ff9ca5-336e-48ed-851d-1989d7c3a03a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:02.954328 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-35ff9ca5-336e-48ed-851d-1989d7c3a03a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1549 microversion: 2.1 time: 0.157479 Aug 10 17:20:02.954940 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 394/799] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:02 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:20:02.974703 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4a67fd76-9ad1-42c3-9441-a794d87c4429 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:02.975196 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4a67fd76-9ad1-42c3-9441-a794d87c4429 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:02.981475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a67fd76-9ad1-42c3-9441-a794d87c4429 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:02.981953 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a67fd76-9ad1-42c3-9441-a794d87c4429 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:02.982608 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a67fd76-9ad1-42c3-9441-a794d87c4429 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:02.983307 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a67fd76-9ad1-42c3-9441-a794d87c4429 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:02.983753 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a67fd76-9ad1-42c3-9441-a794d87c4429 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:02.984175 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a67fd76-9ad1-42c3-9441-a794d87c4429 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:03.061231 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4a67fd76-9ad1-42c3-9441-a794d87c4429 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090622 Aug 10 17:20:03.061875 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 406/800] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 17:20:02 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:03.093295 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d277e252-1d7d-4a5b-99f2-ead215783d2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:03.096012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d277e252-1d7d-4a5b-99f2-ead215783d2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:03.100089 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d277e252-1d7d-4a5b-99f2-ead215783d2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:03.100581 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d277e252-1d7d-4a5b-99f2-ead215783d2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:03.101047 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d277e252-1d7d-4a5b-99f2-ead215783d2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:03.101818 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d277e252-1d7d-4a5b-99f2-ead215783d2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:03.102483 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d277e252-1d7d-4a5b-99f2-ead215783d2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:03.102917 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d277e252-1d7d-4a5b-99f2-ead215783d2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:03.239445 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d277e252-1d7d-4a5b-99f2-ead215783d2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:03.248876 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d277e252-1d7d-4a5b-99f2-ead215783d2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:03.250384 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d277e252-1d7d-4a5b-99f2-ead215783d2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:03.251578 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d277e252-1d7d-4a5b-99f2-ead215783d2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1406 microversion: 2.20 time: 0.162449 Aug 10 17:20:03.252132 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 395/801] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:03 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:20:03.836135 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d194b183-8af1-4c73-bdcd-377ca44cc47c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:03.836893 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d194b183-8af1-4c73-bdcd-377ca44cc47c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:03.843105 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d194b183-8af1-4c73-bdcd-377ca44cc47c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:03.843833 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d194b183-8af1-4c73-bdcd-377ca44cc47c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:03.844285 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d194b183-8af1-4c73-bdcd-377ca44cc47c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:03.845002 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d194b183-8af1-4c73-bdcd-377ca44cc47c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:03.845465 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d194b183-8af1-4c73-bdcd-377ca44cc47c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:03.845902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d194b183-8af1-4c73-bdcd-377ca44cc47c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:03.879654 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d194b183-8af1-4c73-bdcd-377ca44cc47c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:03.880145 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d194b183-8af1-4c73-bdcd-377ca44cc47c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:03.880586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d194b183-8af1-4c73-bdcd-377ca44cc47c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:03.881043 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-d194b183-8af1-4c73-bdcd-377ca44cc47c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lazy-loading 'fault' on Instance uuid 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:20:03.924207 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d194b183-8af1-4c73-bdcd-377ca44cc47c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:03.932233 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d194b183-8af1-4c73-bdcd-377ca44cc47c tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 200 len: 1334 microversion: 2.1 time: 0.101167 Aug 10 17:20:03.933449 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 407/802] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:03 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:04.120944 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-96b6acdb-c0e2-4922-b3a2-43d88a45b4e4 req-507e2874-757d-44b2-b112-f735e43a75d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f39ecbc-070d-4ad9-9ac3-3bb23fe51438", "tag": "380440cb-8fb3-4cef-9587-9e46611a7ec1"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:04.130943 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-96b6acdb-c0e2-4922-b3a2-43d88a45b4e4 req-507e2874-757d-44b2-b112-f735e43a75d7 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:04.133532 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-96b6acdb-c0e2-4922-b3a2-43d88a45b4e4 req-507e2874-757d-44b2-b112-f735e43a75d7 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:04.133532 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-96b6acdb-c0e2-4922-b3a2-43d88a45b4e4 req-507e2874-757d-44b2-b112-f735e43a75d7 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:04.144681 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-96b6acdb-c0e2-4922-b3a2-43d88a45b4e4 req-507e2874-757d-44b2-b112-f735e43a75d7 service nova] Creating event network-changed:380440cb-8fb3-4cef-9587-9e46611a7ec1 for instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 on hv-cinder-85272 Aug 10 17:20:04.150293 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-96b6acdb-c0e2-4922-b3a2-43d88a45b4e4 req-507e2874-757d-44b2-b112-f735e43a75d7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033355 Aug 10 17:20:04.150930 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 396/803] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:04.274268 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a6fda6d7-b5de-49f2-a049-d92870cb9cfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:04.275177 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a6fda6d7-b5de-49f2-a049-d92870cb9cfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:04.281540 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fda6d7-b5de-49f2-a049-d92870cb9cfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:04.282163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fda6d7-b5de-49f2-a049-d92870cb9cfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:04.282779 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fda6d7-b5de-49f2-a049-d92870cb9cfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:04.283589 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fda6d7-b5de-49f2-a049-d92870cb9cfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:04.284157 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fda6d7-b5de-49f2-a049-d92870cb9cfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:04.284697 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fda6d7-b5de-49f2-a049-d92870cb9cfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:04.425740 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a6fda6d7-b5de-49f2-a049-d92870cb9cfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:04.441741 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a6fda6d7-b5de-49f2-a049-d92870cb9cfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:04.443305 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a6fda6d7-b5de-49f2-a049-d92870cb9cfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:04.444516 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a6fda6d7-b5de-49f2-a049-d92870cb9cfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1597 microversion: 2.20 time: 0.174691 Aug 10 17:20:04.445812 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 408/804] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:04 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1597 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:20:04.471619 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4a020093-84f1-4321-a85e-0c0715c3e417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:04.472410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4a020093-84f1-4321-a85e-0c0715c3e417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:04.479215 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a020093-84f1-4321-a85e-0c0715c3e417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:04.479836 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a020093-84f1-4321-a85e-0c0715c3e417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:04.480284 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a020093-84f1-4321-a85e-0c0715c3e417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:04.481176 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a020093-84f1-4321-a85e-0c0715c3e417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:04.481630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a020093-84f1-4321-a85e-0c0715c3e417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:04.482056 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a020093-84f1-4321-a85e-0c0715c3e417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:04.576174 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4a020093-84f1-4321-a85e-0c0715c3e417 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109450 Aug 10 17:20:04.578413 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 397/805] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Aug 10 17:20:04 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:20:04.956052 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f444c014-ce2f-434f-8b1b-61ad969f2e73 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:04.956901 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f444c014-ce2f-434f-8b1b-61ad969f2e73 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: 60a02347-095c-4aa2-92b0-5bcdf5fce2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:04.965026 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f444c014-ce2f-434f-8b1b-61ad969f2e73 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:04.965593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f444c014-ce2f-434f-8b1b-61ad969f2e73 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:04.966102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f444c014-ce2f-434f-8b1b-61ad969f2e73 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:04.966916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f444c014-ce2f-434f-8b1b-61ad969f2e73 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:04.967445 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f444c014-ce2f-434f-8b1b-61ad969f2e73 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:04.967954 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f444c014-ce2f-434f-8b1b-61ad969f2e73 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:04.984619 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-f444c014-ce2f-434f-8b1b-61ad969f2e73 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] HTTP exception thrown: Instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 could not be found. Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f444c014-ce2f-434f-8b1b-61ad969f2e73 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Request method failure captured: Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 HTTP/1.1 Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-dswVGFX6YnssvSdTDTGYKFuPUcQkPiuoht6xjK41FLbLRERzNejhLlYaJj4B97fXmairLkYtq3qAN844xnnJD_nNs69F67xjXDl2MQv0g2LKJF8vMzfdI49Cx11gpD5xAT_u8QAAlFxfzo1W-6WvyoQXKrMEdXy7XIMxCTOEUbAnc Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: 2eb3ea42180f4a0ca5ca3c90962fb301 Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:20:04.986475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:20:04.988148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2eb3ea42180f4a0ca5ca3c90962fb301", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2eb3ea42180f4a0ca5ca3c90962fb301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2eb3ea42180f4a0ca5ca3c90962fb301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2eb3ea42180f4a0ca5ca3c90962fb301"}]}] Aug 10 17:20:04.988148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:20:04.988148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 2eb3ea42180f4a0ca5ca3c90962fb301 Aug 10 17:20:04.988148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:20:04.988148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-ServerRescueNegativeTestJSON-1974687270-project Aug 10 17:20:04.988148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:20:04.988148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:20:04.988148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 7d2a65984c4f42fbb18977c7345c42ce Aug 10 17:20:04.988148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1974687270-project Aug 10 17:20:04.988148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:20:04.988148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 could not be found. Aug 10 17:20:04.988148 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': '60a02347-095c-4aa2-92b0-5bcdf5fce2a9'} Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 could not be found. Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:20:04.989237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 could not be found. Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 could not be found. Aug 10 17:20:04.990754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:20:04.992663 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f444c014-ce2f-434f-8b1b-61ad969f2e73 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Returning 404 to user: Instance 60a02347-095c-4aa2-92b0-5bcdf5fce2a9 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:20:04.993537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f444c014-ce2f-434f-8b1b-61ad969f2e73 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9" status: 404 len: 111 microversion: 2.1 time: 0.042656 Aug 10 17:20:04.997842 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 409/806] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:04 2022] GET /compute/v2.1/servers/60a02347-095c-4aa2-92b0-5bcdf5fce2a9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:20:05.004238 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c807c777-9681-4845-8751-9e9833e407e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '.version_select at 0x7f7eb9e74430>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:05.090479 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c807c777-9681-4845-8751-9e9833e407e8 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653254705" status: 202 len: 0 microversion: 2.1 time: 0.090828 Aug 10 17:20:05.094705 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 398/807] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 10 17:20:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653254705 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:20:05.778331 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-22b08d0e-8fc3-478f-9265-dc256a9d7b1d req-08feb055-554c-4533-b0ff-8ed68eaec841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7eaaa8-2f20-4c87-a62a-e855728effb1", "tag": "d08afacf-c192-4763-9246-60f0a09579d4"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:05.783109 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-22b08d0e-8fc3-478f-9265-dc256a9d7b1d req-08feb055-554c-4533-b0ff-8ed68eaec841 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:05.783593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-22b08d0e-8fc3-478f-9265-dc256a9d7b1d req-08feb055-554c-4533-b0ff-8ed68eaec841 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:05.784036 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-22b08d0e-8fc3-478f-9265-dc256a9d7b1d req-08feb055-554c-4533-b0ff-8ed68eaec841 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:05.795696 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-22b08d0e-8fc3-478f-9265-dc256a9d7b1d req-08feb055-554c-4533-b0ff-8ed68eaec841 service nova] Creating event network-changed:d08afacf-c192-4763-9246-60f0a09579d4 for instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 on hv-cinder-85272 Aug 10 17:20:05.800591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-22b08d0e-8fc3-478f-9265-dc256a9d7b1d req-08feb055-554c-4533-b0ff-8ed68eaec841 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114196 Aug 10 17:20:05.801270 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 410/808] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:08.269920 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-52209f89-5077-43ff-bc48-d6d003f2a0de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64a961b1-3232-4f0c-9ea0-c5c239e9c1b3"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:08.272300 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-52209f89-5077-43ff-bc48-d6d003f2a0de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:08.278897 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-52209f89-5077-43ff-bc48-d6d003f2a0de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:08.279383 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-52209f89-5077-43ff-bc48-d6d003f2a0de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:08.279821 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-52209f89-5077-43ff-bc48-d6d003f2a0de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:08.280516 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-52209f89-5077-43ff-bc48-d6d003f2a0de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:08.280975 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-52209f89-5077-43ff-bc48-d6d003f2a0de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:08.281403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-52209f89-5077-43ff-bc48-d6d003f2a0de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:08.363057 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-52209f89-5077-43ff-bc48-d6d003f2a0de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] HTTP exception thrown: Invalid volume: volume 64a961b1-3232-4f0c-9ea0-c5c239e9c1b3 is already attached to instances: e755ffcc-1904-43e4-b6ab-5132e4e7294e Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-52209f89-5077-43ff-bc48-d6d003f2a0de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Request method failure captured: Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: POST /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments HTTP/1.1 Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 74 Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-d1JeRL-7M2oDNopDjpZUxB7lCyD6gM7mAKQjs1c_tbDXZUJQxtkwNVWBVbSkOO7nl_NecmWamydXOiC8XB5d0eHDfa5nNH50PHdLvbF4dkN-n17ApWL5TP6WLuf0j7atmVYlNbqIzfOOdPkW7Q67otg7JGz72UDMA9zNteHBnnxaI Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:20:08.364872 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:20:08.367630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cfac2c11f1b24456a5a9efaa9112e281", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}] Aug 10 17:20:08.367630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:20:08.367630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:20:08.367630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:20:08.367630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:20:08.367630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:20:08.367630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:20:08.367630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 48feb2fc02f04e739c5e1bf7d68baa16 Aug 10 17:20:08.367630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:20:08.367630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Aug 10 17:20:08.367630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {"volumeAttachment": {"volumeId": "64a961b1-3232-4f0c-9ea0-c5c239e9c1b3"}} Aug 10 17:20:08.367630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Invalid volume: volume 64a961b1-3232-4f0c-9ea0-c5c239e9c1b3 is already attached to instances: e755ffcc-1904-43e4-b6ab-5132e4e7294e Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'server_id': 'e755ffcc-1904-43e4-b6ab-5132e4e7294e', 'body': {'volumeAttachment': {'volumeId': '64a961b1-3232-4f0c-9ea0-c5c239e9c1b3'}}} Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 64a961b1-3232-4f0c-9ea0-c5c239e9c1b3 is already attached to instances: e755ffcc-1904-43e4-b6ab-5132e4e7294e Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:08.368982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 64a961b1-3232-4f0c-9ea0-c5c239e9c1b3 is already attached to instances: e755ffcc-1904-43e4-b6ab-5132e4e7294e Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:08.371410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:20:08.373652 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:20:08.373652 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:20:08.373652 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:20:08.373652 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 64a961b1-3232-4f0c-9ea0-c5c239e9c1b3 is already attached to instances: e755ffcc-1904-43e4-b6ab-5132e4e7294e Aug 10 17:20:08.373652 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:08.373652 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-52209f89-5077-43ff-bc48-d6d003f2a0de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Returning 400 to user: Invalid volume: volume 64a961b1-3232-4f0c-9ea0-c5c239e9c1b3 is already attached to instances: e755ffcc-1904-43e4-b6ab-5132e4e7294e {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:20:08.373652 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-52209f89-5077-43ff-bc48-d6d003f2a0de tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "POST /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101226 Aug 10 17:20:08.373652 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 399/809] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 17:20:08 2022] POST /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:20:08.433693 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c07f43c0-d40a-44e3-8252-df3a80f6f1a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:08.434308 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c07f43c0-d40a-44e3-8252-df3a80f6f1a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:08.440391 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c07f43c0-d40a-44e3-8252-df3a80f6f1a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:08.440879 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c07f43c0-d40a-44e3-8252-df3a80f6f1a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:08.441322 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c07f43c0-d40a-44e3-8252-df3a80f6f1a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:08.442017 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c07f43c0-d40a-44e3-8252-df3a80f6f1a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:08.442516 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c07f43c0-d40a-44e3-8252-df3a80f6f1a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:08.442947 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c07f43c0-d40a-44e3-8252-df3a80f6f1a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:08.527410 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-c07f43c0-d40a-44e3-8252-df3a80f6f1a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lazy-loading 'services' on Instance uuid e755ffcc-1904-43e4-b6ab-5132e4e7294e {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:20:08.604167 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-932172ca-d486-4915-9440-22699d8e93ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:08.604726 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-932172ca-d486-4915-9440-22699d8e93ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:08.611313 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-932172ca-d486-4915-9440-22699d8e93ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:08.611313 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-932172ca-d486-4915-9440-22699d8e93ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:08.611667 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-932172ca-d486-4915-9440-22699d8e93ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:08.612362 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-932172ca-d486-4915-9440-22699d8e93ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:08.612812 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-932172ca-d486-4915-9440-22699d8e93ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:08.613244 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-932172ca-d486-4915-9440-22699d8e93ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:08.639256 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-932172ca-d486-4915-9440-22699d8e93ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:20:08.806055 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c07f43c0-d40a-44e3-8252-df3a80f6f1a8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments/64a961b1-3232-4f0c-9ea0-c5c239e9c1b3" status: 202 len: 0 microversion: 2.1 time: 0.377328 Aug 10 17:20:08.806706 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 411/810] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 17:20:08 2022] DELETE /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments/64a961b1-3232-4f0c-9ea0-c5c239e9c1b3 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:20:08.815535 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dd5a3d31-95ca-40d2-99f0-5f1c265fc844 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:08.817800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dd5a3d31-95ca-40d2-99f0-5f1c265fc844 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:08.824664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5a3d31-95ca-40d2-99f0-5f1c265fc844 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:08.825151 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5a3d31-95ca-40d2-99f0-5f1c265fc844 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:08.825592 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5a3d31-95ca-40d2-99f0-5f1c265fc844 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:08.826293 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5a3d31-95ca-40d2-99f0-5f1c265fc844 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:08.826779 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5a3d31-95ca-40d2-99f0-5f1c265fc844 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:08.827209 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5a3d31-95ca-40d2-99f0-5f1c265fc844 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:08.855905 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dd5a3d31-95ca-40d2-99f0-5f1c265fc844 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044473 Aug 10 17:20:08.856457 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 412/811] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:20:08 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:20:08.991364 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-932172ca-d486-4915-9440-22699d8e93ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "DELETE /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 204 len: 0 microversion: 2.1 time: 0.390400 Aug 10 17:20:08.992801 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 400/812] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:20:08 2022] DELETE /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:20:09.001455 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9827e140-0753-4aa3-a794-c29f052ae486 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:09.002076 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9827e140-0753-4aa3-a794-c29f052ae486 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:09.009064 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9827e140-0753-4aa3-a794-c29f052ae486 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:09.009558 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9827e140-0753-4aa3-a794-c29f052ae486 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:09.010002 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9827e140-0753-4aa3-a794-c29f052ae486 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:09.010865 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9827e140-0753-4aa3-a794-c29f052ae486 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:09.011333 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9827e140-0753-4aa3-a794-c29f052ae486 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:09.011760 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9827e140-0753-4aa3-a794-c29f052ae486 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:09.147678 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9827e140-0753-4aa3-a794-c29f052ae486 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:09.155438 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9827e140-0753-4aa3-a794-c29f052ae486 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1507 microversion: 2.1 time: 0.158084 Aug 10 17:20:09.156005 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 413/813] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:08 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:09.869121 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8b75495f-d8fa-4db1-bf27-5b9f996e1263 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:09.871456 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8b75495f-d8fa-4db1-bf27-5b9f996e1263 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:09.877843 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b75495f-d8fa-4db1-bf27-5b9f996e1263 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:09.878332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b75495f-d8fa-4db1-bf27-5b9f996e1263 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:09.878810 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b75495f-d8fa-4db1-bf27-5b9f996e1263 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:09.879590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b75495f-d8fa-4db1-bf27-5b9f996e1263 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:09.879962 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b75495f-d8fa-4db1-bf27-5b9f996e1263 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:09.880392 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b75495f-d8fa-4db1-bf27-5b9f996e1263 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:09.906568 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:20:09.911239 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8b75495f-d8fa-4db1-bf27-5b9f996e1263 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046993 Aug 10 17:20:09.911790 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 401/814] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:20:09 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:10.176974 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b198e9c4-2b0a-448c-9173-be8d716a8978 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:10.177495 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b198e9c4-2b0a-448c-9173-be8d716a8978 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:10.184335 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b198e9c4-2b0a-448c-9173-be8d716a8978 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:10.184828 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b198e9c4-2b0a-448c-9173-be8d716a8978 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:10.185264 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b198e9c4-2b0a-448c-9173-be8d716a8978 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:10.185959 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b198e9c4-2b0a-448c-9173-be8d716a8978 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:10.186448 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b198e9c4-2b0a-448c-9173-be8d716a8978 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:10.186882 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b198e9c4-2b0a-448c-9173-be8d716a8978 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:10.318012 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b198e9c4-2b0a-448c-9173-be8d716a8978 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:10.326129 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b198e9c4-2b0a-448c-9173-be8d716a8978 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1507 microversion: 2.1 time: 0.153412 Aug 10 17:20:10.327164 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 414/815] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:10 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:10.924298 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e5d9a017-b3fd-4fa0-878e-00a5e5c4a56b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:10.926575 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e5d9a017-b3fd-4fa0-878e-00a5e5c4a56b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:10.934528 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5d9a017-b3fd-4fa0-878e-00a5e5c4a56b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:10.935019 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5d9a017-b3fd-4fa0-878e-00a5e5c4a56b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:10.935551 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5d9a017-b3fd-4fa0-878e-00a5e5c4a56b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:10.936153 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5d9a017-b3fd-4fa0-878e-00a5e5c4a56b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:10.936645 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5d9a017-b3fd-4fa0-878e-00a5e5c4a56b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:10.937068 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5d9a017-b3fd-4fa0-878e-00a5e5c4a56b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:10.966633 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e5d9a017-b3fd-4fa0-878e-00a5e5c4a56b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046589 Aug 10 17:20:10.967204 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 402/816] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:20:10 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:11.347523 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-08d9a16c-3979-4373-8f4a-e83f1718e7a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:11.348239 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-08d9a16c-3979-4373-8f4a-e83f1718e7a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:11.355258 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08d9a16c-3979-4373-8f4a-e83f1718e7a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:11.355751 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08d9a16c-3979-4373-8f4a-e83f1718e7a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:11.356188 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08d9a16c-3979-4373-8f4a-e83f1718e7a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:11.356891 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08d9a16c-3979-4373-8f4a-e83f1718e7a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:11.357348 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08d9a16c-3979-4373-8f4a-e83f1718e7a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:11.357779 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08d9a16c-3979-4373-8f4a-e83f1718e7a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:11.503226 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-08d9a16c-3979-4373-8f4a-e83f1718e7a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:11.512025 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-08d9a16c-3979-4373-8f4a-e83f1718e7a2 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1507 microversion: 2.1 time: 0.168262 Aug 10 17:20:11.512935 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 415/817] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:11 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:11.603256 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-2245d948-8b06-4351-9ef6-a72b17273ebc req-abaf902d-4459-41ca-baf1-4488e2978f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af2fcf04-eb83-455a-bb58-b8c23b16f58d", "name": "network-vif-deleted", "tag": "b302d1cc-652d-4c9c-add6-c1dc1428f8c5"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:11.614111 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2245d948-8b06-4351-9ef6-a72b17273ebc req-abaf902d-4459-41ca-baf1-4488e2978f56 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:11.614978 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2245d948-8b06-4351-9ef6-a72b17273ebc req-abaf902d-4459-41ca-baf1-4488e2978f56 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:11.615412 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2245d948-8b06-4351-9ef6-a72b17273ebc req-abaf902d-4459-41ca-baf1-4488e2978f56 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:11.627984 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-2245d948-8b06-4351-9ef6-a72b17273ebc req-abaf902d-4459-41ca-baf1-4488e2978f56 service nova] Creating event network-vif-deleted:b302d1cc-652d-4c9c-add6-c1dc1428f8c5 for instance af2fcf04-eb83-455a-bb58-b8c23b16f58d on hv-cinder-85272 Aug 10 17:20:11.632714 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-2245d948-8b06-4351-9ef6-a72b17273ebc req-abaf902d-4459-41ca-baf1-4488e2978f56 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034161 Aug 10 17:20:11.633312 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 403/818] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:11.979927 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-05f7e8a5-cd20-446a-912e-92e40fdcfd26 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:11.982771 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-05f7e8a5-cd20-446a-912e-92e40fdcfd26 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:11.989588 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05f7e8a5-cd20-446a-912e-92e40fdcfd26 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:11.990172 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05f7e8a5-cd20-446a-912e-92e40fdcfd26 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:11.990865 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05f7e8a5-cd20-446a-912e-92e40fdcfd26 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:11.991607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05f7e8a5-cd20-446a-912e-92e40fdcfd26 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:11.991998 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05f7e8a5-cd20-446a-912e-92e40fdcfd26 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:11.992464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05f7e8a5-cd20-446a-912e-92e40fdcfd26 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:11.997575 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:20:12.024275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-05f7e8a5-cd20-446a-912e-92e40fdcfd26 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049083 Aug 10 17:20:12.024835 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 416/819] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:20:11 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:20:12.088749 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1679dddf-e30a-4dff-a5dc-cbc9ea350c51 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:12.089367 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1679dddf-e30a-4dff-a5dc-cbc9ea350c51 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:12.095735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1679dddf-e30a-4dff-a5dc-cbc9ea350c51 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:12.096243 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1679dddf-e30a-4dff-a5dc-cbc9ea350c51 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:12.096664 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1679dddf-e30a-4dff-a5dc-cbc9ea350c51 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:12.097359 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1679dddf-e30a-4dff-a5dc-cbc9ea350c51 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:12.097821 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1679dddf-e30a-4dff-a5dc-cbc9ea350c51 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:12.098247 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1679dddf-e30a-4dff-a5dc-cbc9ea350c51 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:12.126149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1679dddf-e30a-4dff-a5dc-cbc9ea350c51 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:20:12.407508 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1679dddf-e30a-4dff-a5dc-cbc9ea350c51 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 204 len: 0 microversion: 2.1 time: 0.323511 Aug 10 17:20:12.408345 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 404/820] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:20:12 2022] DELETE /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:20:12.417381 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3599bbe2-dde4-489a-8471-239bcdd94a87 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:12.418001 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3599bbe2-dde4-489a-8471-239bcdd94a87 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:12.424732 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3599bbe2-dde4-489a-8471-239bcdd94a87 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:12.425223 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3599bbe2-dde4-489a-8471-239bcdd94a87 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:12.425666 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3599bbe2-dde4-489a-8471-239bcdd94a87 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:12.426373 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3599bbe2-dde4-489a-8471-239bcdd94a87 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:12.426839 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3599bbe2-dde4-489a-8471-239bcdd94a87 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:12.427269 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3599bbe2-dde4-489a-8471-239bcdd94a87 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:12.533685 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a0eb2e88-ca3b-45a6-b618-7ecaa234d141 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:12.534412 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a0eb2e88-ca3b-45a6-b618-7ecaa234d141 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:12.540490 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a0eb2e88-ca3b-45a6-b618-7ecaa234d141 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:12.541012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a0eb2e88-ca3b-45a6-b618-7ecaa234d141 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:12.541422 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a0eb2e88-ca3b-45a6-b618-7ecaa234d141 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:12.545877 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a0eb2e88-ca3b-45a6-b618-7ecaa234d141 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:12.545877 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a0eb2e88-ca3b-45a6-b618-7ecaa234d141 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:12.545877 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a0eb2e88-ca3b-45a6-b618-7ecaa234d141 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:12.563992 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3599bbe2-dde4-489a-8471-239bcdd94a87 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:12.571780 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3599bbe2-dde4-489a-8471-239bcdd94a87 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1680 microversion: 2.1 time: 0.159075 Aug 10 17:20:12.572348 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 417/821] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:12 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:12.592064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a0eb2e88-ca3b-45a6-b618-7ecaa234d141 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:12.592064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a0eb2e88-ca3b-45a6-b618-7ecaa234d141 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:12.592064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a0eb2e88-ca3b-45a6-b618-7ecaa234d141 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:12.592064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-a0eb2e88-ca3b-45a6-b618-7ecaa234d141 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lazy-loading 'fault' on Instance uuid af2fcf04-eb83-455a-bb58-b8c23b16f58d {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:20:12.626249 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a0eb2e88-ca3b-45a6-b618-7ecaa234d141 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:12.630216 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a0eb2e88-ca3b-45a6-b618-7ecaa234d141 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1312 microversion: 2.1 time: 0.100763 Aug 10 17:20:12.630820 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 405/822] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:12 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:20:13.594412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5a6f4852-32b4-4ff6-b91b-8fa1e9dcd802 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:13.595026 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5a6f4852-32b4-4ff6-b91b-8fa1e9dcd802 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:13.601399 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a6f4852-32b4-4ff6-b91b-8fa1e9dcd802 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:13.601918 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a6f4852-32b4-4ff6-b91b-8fa1e9dcd802 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:13.602385 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a6f4852-32b4-4ff6-b91b-8fa1e9dcd802 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:13.603083 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a6f4852-32b4-4ff6-b91b-8fa1e9dcd802 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:13.603543 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a6f4852-32b4-4ff6-b91b-8fa1e9dcd802 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:13.603976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a6f4852-32b4-4ff6-b91b-8fa1e9dcd802 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:13.650737 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0d0d4f10-453b-4cde-a142-701b8ca5ba51 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:13.651946 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0d0d4f10-453b-4cde-a142-701b8ca5ba51 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:13.658477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0d4f10-453b-4cde-a142-701b8ca5ba51 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:13.658972 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0d4f10-453b-4cde-a142-701b8ca5ba51 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:13.659412 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0d4f10-453b-4cde-a142-701b8ca5ba51 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:13.660114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0d4f10-453b-4cde-a142-701b8ca5ba51 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:13.660573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0d4f10-453b-4cde-a142-701b8ca5ba51 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:13.660996 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0d4f10-453b-4cde-a142-701b8ca5ba51 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:13.693190 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0d4f10-453b-4cde-a142-701b8ca5ba51 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:13.693679 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0d4f10-453b-4cde-a142-701b8ca5ba51 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:13.694167 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0d4f10-453b-4cde-a142-701b8ca5ba51 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:13.694606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-0d0d4f10-453b-4cde-a142-701b8ca5ba51 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lazy-loading 'fault' on Instance uuid af2fcf04-eb83-455a-bb58-b8c23b16f58d {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:20:13.746938 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0d0d4f10-453b-4cde-a142-701b8ca5ba51 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:13.754754 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0d0d4f10-453b-4cde-a142-701b8ca5ba51 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 200 len: 1312 microversion: 2.1 time: 0.107741 Aug 10 17:20:13.755338 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 406/823] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:13 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:20:13.769971 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5a6f4852-32b4-4ff6-b91b-8fa1e9dcd802 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:13.778485 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5a6f4852-32b4-4ff6-b91b-8fa1e9dcd802 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1680 microversion: 2.1 time: 0.187849 Aug 10 17:20:13.779052 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 418/824] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:13 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:14.778155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-53904fee-bc0c-4345-b0eb-b70448dcfd46 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:14.780265 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-53904fee-bc0c-4345-b0eb-b70448dcfd46 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: af2fcf04-eb83-455a-bb58-b8c23b16f58d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:14.788033 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53904fee-bc0c-4345-b0eb-b70448dcfd46 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:14.788494 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53904fee-bc0c-4345-b0eb-b70448dcfd46 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:14.788886 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53904fee-bc0c-4345-b0eb-b70448dcfd46 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:14.789605 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53904fee-bc0c-4345-b0eb-b70448dcfd46 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:14.790071 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53904fee-bc0c-4345-b0eb-b70448dcfd46 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:14.790559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53904fee-bc0c-4345-b0eb-b70448dcfd46 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:14.803149 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7bd17565-8c5e-43e0-87e6-22235f91d5a7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:14.804559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7bd17565-8c5e-43e0-87e6-22235f91d5a7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:14.806243 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-53904fee-bc0c-4345-b0eb-b70448dcfd46 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] HTTP exception thrown: Instance af2fcf04-eb83-455a-bb58-b8c23b16f58d could not be found. Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-53904fee-bc0c-4345-b0eb-b70448dcfd46 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Request method failure captured: Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d HTTP/1.1 Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-dswVGFX6YnssvSdTDTGYKFuPUcQkPiuoht6xjK41FLbLRERzNejhLlYaJj4B97fXmairLkYtq3qAN844xnnJD_nNs69F67xjXDl2MQv0g2LKJF8vMzfdI49Cx11gpD5xAT_u8QAAlFxfzo1W-6WvyoQXKrMEdXy7XIMxCTOEUbAnc Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: 2eb3ea42180f4a0ca5ca3c90962fb301 Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:20:14.808507 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:20:14.809809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2eb3ea42180f4a0ca5ca3c90962fb301", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2eb3ea42180f4a0ca5ca3c90962fb301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2eb3ea42180f4a0ca5ca3c90962fb301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2eb3ea42180f4a0ca5ca3c90962fb301"}]}] Aug 10 17:20:14.809809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:20:14.809809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 2eb3ea42180f4a0ca5ca3c90962fb301 Aug 10 17:20:14.809809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:20:14.809809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-ServerRescueNegativeTestJSON-1974687270-project Aug 10 17:20:14.809809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:20:14.809809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:20:14.809809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 7d2a65984c4f42fbb18977c7345c42ce Aug 10 17:20:14.809809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1974687270-project Aug 10 17:20:14.809809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:20:14.809809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance af2fcf04-eb83-455a-bb58-b8c23b16f58d could not be found. Aug 10 17:20:14.809809 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': 'af2fcf04-eb83-455a-bb58-b8c23b16f58d'} Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af2fcf04-eb83-455a-bb58-b8c23b16f58d could not be found. Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:20:14.810613 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af2fcf04-eb83-455a-bb58-b8c23b16f58d could not be found. Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af2fcf04-eb83-455a-bb58-b8c23b16f58d could not be found. Aug 10 17:20:14.812432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:14.813603 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-53904fee-bc0c-4345-b0eb-b70448dcfd46 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Returning 404 to user: Instance af2fcf04-eb83-455a-bb58-b8c23b16f58d could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:20:14.813603 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-53904fee-bc0c-4345-b0eb-b70448dcfd46 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d" status: 404 len: 111 microversion: 2.1 time: 0.038210 Aug 10 17:20:14.813603 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 407/825] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:14 2022] GET /compute/v2.1/servers/af2fcf04-eb83-455a-bb58-b8c23b16f58d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:20:14.818162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7bd17565-8c5e-43e0-87e6-22235f91d5a7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:14.818774 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7bd17565-8c5e-43e0-87e6-22235f91d5a7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:14.819214 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7bd17565-8c5e-43e0-87e6-22235f91d5a7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:14.820069 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7bd17565-8c5e-43e0-87e6-22235f91d5a7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:14.820535 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7bd17565-8c5e-43e0-87e6-22235f91d5a7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:14.820638 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4676642c-d2b5-438d-929a-2a6d5de711ba tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:14.820960 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7bd17565-8c5e-43e0-87e6-22235f91d5a7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:14.821065 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4676642c-d2b5-438d-929a-2a6d5de711ba tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:14.828779 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4676642c-d2b5-438d-929a-2a6d5de711ba tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:14.829796 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4676642c-d2b5-438d-929a-2a6d5de711ba tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:14.830303 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4676642c-d2b5-438d-929a-2a6d5de711ba tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:14.831090 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4676642c-d2b5-438d-929a-2a6d5de711ba tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:14.832143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4676642c-d2b5-438d-929a-2a6d5de711ba tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:14.832582 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4676642c-d2b5-438d-929a-2a6d5de711ba tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:14.864508 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4676642c-d2b5-438d-929a-2a6d5de711ba tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:20:14.964569 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7bd17565-8c5e-43e0-87e6-22235f91d5a7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:14.972622 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7bd17565-8c5e-43e0-87e6-22235f91d5a7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1680 microversion: 2.1 time: 0.176127 Aug 10 17:20:14.973207 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 419/826] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:14 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:20:15.254050 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4676642c-d2b5-438d-929a-2a6d5de711ba tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "DELETE /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 204 len: 0 microversion: 2.1 time: 0.437412 Aug 10 17:20:15.254737 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 408/827] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:20:14 2022] DELETE /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:20:15.263840 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0d43e25f-d670-4a59-ba47-30716e6ce866 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:15.264530 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0d43e25f-d670-4a59-ba47-30716e6ce866 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:15.270506 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d43e25f-d670-4a59-ba47-30716e6ce866 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:15.270992 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d43e25f-d670-4a59-ba47-30716e6ce866 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:15.271430 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d43e25f-d670-4a59-ba47-30716e6ce866 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:15.272117 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d43e25f-d670-4a59-ba47-30716e6ce866 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:15.272569 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d43e25f-d670-4a59-ba47-30716e6ce866 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:15.273039 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d43e25f-d670-4a59-ba47-30716e6ce866 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:15.411570 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0d43e25f-d670-4a59-ba47-30716e6ce866 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:15.419299 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0d43e25f-d670-4a59-ba47-30716e6ce866 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.160366 Aug 10 17:20:15.419873 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 420/828] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:15 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:15.568246 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-72151191-eb6a-432a-ac72-e5b970ae945f req-fd3400ce-b643-4b8b-acb0-2bca1bfe8918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e755ffcc-1904-43e4-b6ab-5132e4e7294e", "name": "network-vif-deleted", "tag": "c4c22bfb-50a9-4cd8-b161-a090e4995343"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:15.577672 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-72151191-eb6a-432a-ac72-e5b970ae945f req-fd3400ce-b643-4b8b-acb0-2bca1bfe8918 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:15.578328 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-72151191-eb6a-432a-ac72-e5b970ae945f req-fd3400ce-b643-4b8b-acb0-2bca1bfe8918 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:15.578877 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-72151191-eb6a-432a-ac72-e5b970ae945f req-fd3400ce-b643-4b8b-acb0-2bca1bfe8918 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:15.591840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-72151191-eb6a-432a-ac72-e5b970ae945f req-fd3400ce-b643-4b8b-acb0-2bca1bfe8918 service nova] Creating event network-vif-deleted:c4c22bfb-50a9-4cd8-b161-a090e4995343 for instance e755ffcc-1904-43e4-b6ab-5132e4e7294e on hv-cinder-85272 Aug 10 17:20:15.596956 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-72151191-eb6a-432a-ac72-e5b970ae945f req-fd3400ce-b643-4b8b-acb0-2bca1bfe8918 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032839 Aug 10 17:20:15.597550 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 409/829] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:15.995855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6d0d653f-8a12-4b94-a107-f24e5d470966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:15.996452 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6d0d653f-8a12-4b94-a107-f24e5d470966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:16.008011 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d0d653f-8a12-4b94-a107-f24e5d470966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:16.008793 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d0d653f-8a12-4b94-a107-f24e5d470966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:16.009217 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d0d653f-8a12-4b94-a107-f24e5d470966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:16.010025 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d0d653f-8a12-4b94-a107-f24e5d470966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:16.010576 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d0d653f-8a12-4b94-a107-f24e5d470966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:16.011292 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d0d653f-8a12-4b94-a107-f24e5d470966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:16.091575 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6d0d653f-8a12-4b94-a107-f24e5d470966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:16.104972 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6d0d653f-8a12-4b94-a107-f24e5d470966 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1612 microversion: 2.1 time: 0.111290 Aug 10 17:20:16.104972 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 421/830] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:15 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1612 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:16.443590 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-81986ae6-717a-403e-b5d4-5438636963ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:16.444303 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-81986ae6-717a-403e-b5d4-5438636963ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:16.451202 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81986ae6-717a-403e-b5d4-5438636963ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:16.451692 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81986ae6-717a-403e-b5d4-5438636963ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:16.452132 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81986ae6-717a-403e-b5d4-5438636963ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:16.452829 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81986ae6-717a-403e-b5d4-5438636963ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:16.453292 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81986ae6-717a-403e-b5d4-5438636963ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:16.453712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81986ae6-717a-403e-b5d4-5438636963ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:16.634403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-81986ae6-717a-403e-b5d4-5438636963ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:16.642926 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-81986ae6-717a-403e-b5d4-5438636963ad tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.205442 Aug 10 17:20:16.643516 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 410/831] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:16 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:17.129602 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6e28fcc7-3f54-4c7f-b94a-fa200ad89fe1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:17.130250 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6e28fcc7-3f54-4c7f-b94a-fa200ad89fe1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:17.137749 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e28fcc7-3f54-4c7f-b94a-fa200ad89fe1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:17.138235 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e28fcc7-3f54-4c7f-b94a-fa200ad89fe1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:17.138782 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e28fcc7-3f54-4c7f-b94a-fa200ad89fe1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:17.139479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e28fcc7-3f54-4c7f-b94a-fa200ad89fe1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:17.139937 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e28fcc7-3f54-4c7f-b94a-fa200ad89fe1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:17.140366 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e28fcc7-3f54-4c7f-b94a-fa200ad89fe1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:17.202160 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6e28fcc7-3f54-4c7f-b94a-fa200ad89fe1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:17.210286 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6e28fcc7-3f54-4c7f-b94a-fa200ad89fe1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1612 microversion: 2.1 time: 0.084527 Aug 10 17:20:17.210878 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 422/832] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:17 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1612 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:17.664117 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6e02f35d-ddec-4b4f-b792-5accbb3d9aed tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:17.664724 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6e02f35d-ddec-4b4f-b792-5accbb3d9aed tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:17.671992 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e02f35d-ddec-4b4f-b792-5accbb3d9aed tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:17.672481 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e02f35d-ddec-4b4f-b792-5accbb3d9aed tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:17.672949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e02f35d-ddec-4b4f-b792-5accbb3d9aed tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:17.673660 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e02f35d-ddec-4b4f-b792-5accbb3d9aed tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:17.674112 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e02f35d-ddec-4b4f-b792-5accbb3d9aed tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:17.674568 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e02f35d-ddec-4b4f-b792-5accbb3d9aed tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:17.812425 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6e02f35d-ddec-4b4f-b792-5accbb3d9aed tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:17.820182 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6e02f35d-ddec-4b4f-b792-5accbb3d9aed tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1521 microversion: 2.1 time: 0.159871 Aug 10 17:20:17.820759 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 411/833] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:17 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:18.232355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-16fd031d-3b8d-4537-b8c5-e8d9103632ee tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:18.232980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-16fd031d-3b8d-4537-b8c5-e8d9103632ee tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:18.239840 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16fd031d-3b8d-4537-b8c5-e8d9103632ee tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:18.240328 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16fd031d-3b8d-4537-b8c5-e8d9103632ee tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:18.240792 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16fd031d-3b8d-4537-b8c5-e8d9103632ee tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:18.241502 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16fd031d-3b8d-4537-b8c5-e8d9103632ee tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:18.241961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16fd031d-3b8d-4537-b8c5-e8d9103632ee tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:18.242411 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16fd031d-3b8d-4537-b8c5-e8d9103632ee tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:18.308582 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-16fd031d-3b8d-4537-b8c5-e8d9103632ee tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:18.316296 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-16fd031d-3b8d-4537-b8c5-e8d9103632ee tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 200 len: 1325 microversion: 2.1 time: 0.088595 Aug 10 17:20:18.316867 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 423/834] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:18 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 1325 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:18.753662 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-67764eb0-245f-4301-8610-ca8d29e0ebe3 req-850806bb-ee2f-478b-a8c3-fcb4d1542d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb", "name": "network-vif-deleted", "tag": "f385660a-21a4-436a-92ac-359d6c02f514"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:18.764824 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-67764eb0-245f-4301-8610-ca8d29e0ebe3 req-850806bb-ee2f-478b-a8c3-fcb4d1542d87 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:18.765290 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-67764eb0-245f-4301-8610-ca8d29e0ebe3 req-850806bb-ee2f-478b-a8c3-fcb4d1542d87 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:18.765718 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-67764eb0-245f-4301-8610-ca8d29e0ebe3 req-850806bb-ee2f-478b-a8c3-fcb4d1542d87 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:18.777923 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-67764eb0-245f-4301-8610-ca8d29e0ebe3 req-850806bb-ee2f-478b-a8c3-fcb4d1542d87 service nova] Creating event network-vif-deleted:f385660a-21a4-436a-92ac-359d6c02f514 for instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb on hv-cinder-85272 Aug 10 17:20:18.783043 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-67764eb0-245f-4301-8610-ca8d29e0ebe3 req-850806bb-ee2f-478b-a8c3-fcb4d1542d87 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033028 Aug 10 17:20:18.783592 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 412/835] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:18.841753 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-515e7e0c-67db-440b-9553-d2e7b4685899 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:18.842401 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-515e7e0c-67db-440b-9553-d2e7b4685899 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:18.848311 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-515e7e0c-67db-440b-9553-d2e7b4685899 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:18.848788 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-515e7e0c-67db-440b-9553-d2e7b4685899 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:18.849220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-515e7e0c-67db-440b-9553-d2e7b4685899 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:18.849916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-515e7e0c-67db-440b-9553-d2e7b4685899 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:18.850366 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-515e7e0c-67db-440b-9553-d2e7b4685899 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:18.850796 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-515e7e0c-67db-440b-9553-d2e7b4685899 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:18.918341 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-515e7e0c-67db-440b-9553-d2e7b4685899 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:18.926102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-515e7e0c-67db-440b-9553-d2e7b4685899 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1479 microversion: 2.1 time: 0.088282 Aug 10 17:20:18.926900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 424/836] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:18 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1479 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:19.337606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6cd8048b-0cc2-4bea-a005-86098e351616 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:19.338318 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6cd8048b-0cc2-4bea-a005-86098e351616 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:19.345317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cd8048b-0cc2-4bea-a005-86098e351616 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:19.345807 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cd8048b-0cc2-4bea-a005-86098e351616 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:19.346248 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cd8048b-0cc2-4bea-a005-86098e351616 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:19.346991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cd8048b-0cc2-4bea-a005-86098e351616 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:19.347451 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cd8048b-0cc2-4bea-a005-86098e351616 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:19.347890 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cd8048b-0cc2-4bea-a005-86098e351616 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:19.362194 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-6cd8048b-0cc2-4bea-a005-86098e351616 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] HTTP exception thrown: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6cd8048b-0cc2-4bea-a005-86098e351616 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Request method failure captured: Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e HTTP/1.1 Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-d1JeRL-7M2oDNopDjpZUxB7lCyD6gM7mAKQjs1c_tbDXZUJQxtkwNVWBVbSkOO7nl_NecmWamydXOiC8XB5d0eHDfa5nNH50PHdLvbF4dkN-n17ApWL5TP6WLuf0j7atmVYlNbqIzfOOdPkW7Q67otg7JGz72UDMA9zNteHBnnxaI Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:20:19.364054 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:20:19.365643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cfac2c11f1b24456a5a9efaa9112e281", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}] Aug 10 17:20:19.365643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:20:19.365643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:20:19.365643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:20:19.365643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:20:19.365643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:20:19.365643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:20:19.365643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 48feb2fc02f04e739c5e1bf7d68baa16 Aug 10 17:20:19.365643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:20:19.365643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:20:19.365643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:20:19.365643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': 'e755ffcc-1904-43e4-b6ab-5132e4e7294e'} Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:20:19.366560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:20:19.367746 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:19.368959 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6cd8048b-0cc2-4bea-a005-86098e351616 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Returning 404 to user: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:20:19.368959 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6cd8048b-0cc2-4bea-a005-86098e351616 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 404 len: 111 microversion: 2.1 time: 0.032123 Aug 10 17:20:19.368959 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 413/837] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:19 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:20:19.375607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ee9f62bf-8004-4d4a-a356-ba065652fe83 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '.version_select at 0x7f7eb9e989d0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:19.442865 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ee9f62bf-8004-4d4a-a356-ba065652fe83 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-39133218" status: 202 len: 0 microversion: 2.1 time: 0.072236 Aug 10 17:20:19.443473 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 425/838] 10.222.0.45 () {58 vars in 1215 bytes} [Wed Aug 10 17:20:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-39133218 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:20:19.947816 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ccf46ef8-8df7-425b-8697-c7db2000bfd4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:19.949291 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ccf46ef8-8df7-425b-8697-c7db2000bfd4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:19.955720 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ccf46ef8-8df7-425b-8697-c7db2000bfd4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:19.956216 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ccf46ef8-8df7-425b-8697-c7db2000bfd4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:19.956658 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ccf46ef8-8df7-425b-8697-c7db2000bfd4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:19.957357 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ccf46ef8-8df7-425b-8697-c7db2000bfd4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:19.957881 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ccf46ef8-8df7-425b-8697-c7db2000bfd4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:19.958298 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ccf46ef8-8df7-425b-8697-c7db2000bfd4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:19.990534 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ccf46ef8-8df7-425b-8697-c7db2000bfd4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:19.990947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ccf46ef8-8df7-425b-8697-c7db2000bfd4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:19.991387 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ccf46ef8-8df7-425b-8697-c7db2000bfd4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:19.991843 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-ccf46ef8-8df7-425b-8697-c7db2000bfd4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lazy-loading 'fault' on Instance uuid df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:20:20.048123 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ccf46ef8-8df7-425b-8697-c7db2000bfd4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d2a65984c4f42fbb18977c7345c42ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb3ea42180f4a0ca5ca3c90962fb301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:20.055059 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ccf46ef8-8df7-425b-8697-c7db2000bfd4 tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 200 len: 1312 microversion: 2.1 time: 0.111060 Aug 10 17:20:20.055669 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 414/839] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:19 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:20.286937 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-35034116-0e22-4bab-b57c-35e79f905a25 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Action: 'create', calling method: .version_select at 0x7f7eb9e35d30>, body: {"keypair": {"name": "tempest-keypair-2144998905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEW3omJ/ad0SQx+M6GRJkwuI3rErfU45rZ5Q7GahxH/deDyGaticpzYeajCZv5smsa6g4ohcSN4p1A4JMNR+mVjgEROTj8/2S1GS0DOe2EgKzTsXNbeDjEfntE6OEM5sKA=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:20.302945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-35034116-0e22-4bab-b57c-35e79f905a25 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:20:20.307694 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-35034116-0e22-4bab-b57c-35e79f905a25 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for user 48feb2fc02f04e739c5e1bf7d68baa16 and project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:20:20.396762 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-35034116-0e22-4bab-b57c-35e79f905a25 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113688 Aug 10 17:20:20.397447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 426/840] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 17:20:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:20:21.076569 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-40f3049b-42cf-49b9-98de-8d92b916c2bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:21.077162 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-40f3049b-42cf-49b9-98de-8d92b916c2bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] [instance: df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:21.083519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40f3049b-42cf-49b9-98de-8d92b916c2bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:21.084014 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40f3049b-42cf-49b9-98de-8d92b916c2bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:21.084456 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40f3049b-42cf-49b9-98de-8d92b916c2bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:21.085154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40f3049b-42cf-49b9-98de-8d92b916c2bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:21.085611 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40f3049b-42cf-49b9-98de-8d92b916c2bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:21.086042 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-40f3049b-42cf-49b9-98de-8d92b916c2bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:21.100270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-40f3049b-42cf-49b9-98de-8d92b916c2bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] HTTP exception thrown: Instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb could not be found. Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-40f3049b-42cf-49b9-98de-8d92b916c2bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Request method failure captured: Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb HTTP/1.1 Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-dswVGFX6YnssvSdTDTGYKFuPUcQkPiuoht6xjK41FLbLRERzNejhLlYaJj4B97fXmairLkYtq3qAN844xnnJD_nNs69F67xjXDl2MQv0g2LKJF8vMzfdI49Cx11gpD5xAT_u8QAAlFxfzo1W-6WvyoQXKrMEdXy7XIMxCTOEUbAnc Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: 2eb3ea42180f4a0ca5ca3c90962fb301 Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:20:21.101850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:20:21.103520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2eb3ea42180f4a0ca5ca3c90962fb301", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2eb3ea42180f4a0ca5ca3c90962fb301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2eb3ea42180f4a0ca5ca3c90962fb301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2eb3ea42180f4a0ca5ca3c90962fb301"}]}] Aug 10 17:20:21.103520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:20:21.103520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 2eb3ea42180f4a0ca5ca3c90962fb301 Aug 10 17:20:21.103520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1974687270 Aug 10 17:20:21.103520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-ServerRescueNegativeTestJSON-1974687270-project Aug 10 17:20:21.103520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:20:21.103520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:20:21.103520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 7d2a65984c4f42fbb18977c7345c42ce Aug 10 17:20:21.103520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1974687270-project Aug 10 17:20:21.103520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:20:21.103520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb could not be found. Aug 10 17:20:21.103520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': 'df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb'} Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb could not be found. Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:20:21.104343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb could not be found. Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb could not be found. Aug 10 17:20:21.106373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:20:21.107728 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-40f3049b-42cf-49b9-98de-8d92b916c2bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] Returning 404 to user: Instance df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:20:21.107728 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-40f3049b-42cf-49b9-98de-8d92b916c2bc tempest-ServerRescueNegativeTestJSON-1974687270 tempest-ServerRescueNegativeTestJSON-1974687270-project] 10.222.0.45 "GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb" status: 404 len: 111 microversion: 2.1 time: 0.030914 Aug 10 17:20:21.107728 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 415/841] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:21 2022] GET /compute/v2.1/servers/df7dc9a1-0ddf-47ca-b6a0-4e93b183b6cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:20:22.878558 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1961030201", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df762851-303d-4aa3-ad7c-336bef1a7d98"}], "security_groups": [{"name": "tempest-securitygroup--535271584"}], "key_name": "tempest-keypair-2144998905", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:23.024358 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] validate_networks() for [('df762851-303d-4aa3-ad7c-336bef1a7d98', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:20:23.497765 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:20:23.498201 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:20:23.498787 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:20:23.499196 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:20:23.499605 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:20:23.509682 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:23.510167 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:23.512327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:23.512327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:23.512327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:23.512634 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:23.529720 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:20:23.534222 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Getting quotas for user 48feb2fc02f04e739c5e1bf7d68baa16 and project cfac2c11f1b24456a5a9efaa9112e281. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:20:23.548512 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:20:23.550826 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:20:23.694721 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-98946b1b-9dad-46ea-a610-fdfbbbe30440 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.820473 Aug 10 17:20:23.695817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 427/842] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:20:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:20:23.707213 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-94392477-2ed8-4d1d-85d4-d6b891497625 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:23.708162 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-94392477-2ed8-4d1d-85d4-d6b891497625 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:23.798503 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-94392477-2ed8-4d1d-85d4-d6b891497625 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:23.807168 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-94392477-2ed8-4d1d-85d4-d6b891497625 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1242 microversion: 2.1 time: 0.103826 Aug 10 17:20:23.808957 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 416/843] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:23 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1242 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:24.828783 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dd54c679-b2e7-4fb2-8d55-423509aabd8e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:24.830103 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dd54c679-b2e7-4fb2-8d55-423509aabd8e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:24.837715 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd54c679-b2e7-4fb2-8d55-423509aabd8e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:24.838379 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd54c679-b2e7-4fb2-8d55-423509aabd8e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:24.838962 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd54c679-b2e7-4fb2-8d55-423509aabd8e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:24.840323 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd54c679-b2e7-4fb2-8d55-423509aabd8e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:24.840880 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd54c679-b2e7-4fb2-8d55-423509aabd8e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:24.841408 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd54c679-b2e7-4fb2-8d55-423509aabd8e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:24.953077 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dd54c679-b2e7-4fb2-8d55-423509aabd8e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:24.962156 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dd54c679-b2e7-4fb2-8d55-423509aabd8e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1246 microversion: 2.1 time: 0.137470 Aug 10 17:20:24.964685 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 428/844] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:24 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1246 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:25.984328 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-067a29a4-0071-42f9-895d-4d4f4c3df7a1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:25.985080 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-067a29a4-0071-42f9-895d-4d4f4c3df7a1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:25.992249 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-067a29a4-0071-42f9-895d-4d4f4c3df7a1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:25.992735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-067a29a4-0071-42f9-895d-4d4f4c3df7a1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:26.000366 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-067a29a4-0071-42f9-895d-4d4f4c3df7a1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:26.000366 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-067a29a4-0071-42f9-895d-4d4f4c3df7a1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:26.000366 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-067a29a4-0071-42f9-895d-4d4f4c3df7a1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:26.000366 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-067a29a4-0071-42f9-895d-4d4f4c3df7a1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:26.057131 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-067a29a4-0071-42f9-895d-4d4f4c3df7a1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:26.065359 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-067a29a4-0071-42f9-895d-4d4f4c3df7a1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1294 microversion: 2.1 time: 0.085066 Aug 10 17:20:26.065927 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 417/845] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:25 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:27.091319 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-30c15702-6fb8-442d-8617-22216f71f211 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:27.094575 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-30c15702-6fb8-442d-8617-22216f71f211 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:27.099646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-30c15702-6fb8-442d-8617-22216f71f211 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:27.100379 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-30c15702-6fb8-442d-8617-22216f71f211 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:27.101064 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-30c15702-6fb8-442d-8617-22216f71f211 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:27.101860 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-30c15702-6fb8-442d-8617-22216f71f211 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:27.102568 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-30c15702-6fb8-442d-8617-22216f71f211 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:27.103106 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-30c15702-6fb8-442d-8617-22216f71f211 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:27.184709 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-30c15702-6fb8-442d-8617-22216f71f211 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:27.194266 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-30c15702-6fb8-442d-8617-22216f71f211 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1312 microversion: 2.1 time: 0.108292 Aug 10 17:20:27.197717 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 429/846] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:27 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:20:28.218900 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a4d8612b-ae80-4037-88f7-5790ec2d646d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:28.219483 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a4d8612b-ae80-4037-88f7-5790ec2d646d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:28.222035 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:20:28.226819 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4d8612b-ae80-4037-88f7-5790ec2d646d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:28.227359 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4d8612b-ae80-4037-88f7-5790ec2d646d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:28.227800 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4d8612b-ae80-4037-88f7-5790ec2d646d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:28.228496 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4d8612b-ae80-4037-88f7-5790ec2d646d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:28.228950 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4d8612b-ae80-4037-88f7-5790ec2d646d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:28.229377 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4d8612b-ae80-4037-88f7-5790ec2d646d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:28.371620 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a4d8612b-ae80-4037-88f7-5790ec2d646d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:28.379287 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a4d8612b-ae80-4037-88f7-5790ec2d646d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1367 microversion: 2.1 time: 0.164898 Aug 10 17:20:28.379864 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 418/847] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:28 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:28.555852 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-5e84f563-366e-4fc5-ad09-ab83e6f414af req-121d2ba1-75de-4f22-9515-8f1d2df1b01e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d76607cf-e08a-4b20-8edb-4fef90a17fb9", "tag": "6f7538a1-11a6-4fe2-a404-3fe6642cb47c"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:28.561905 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:20:28.567415 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-5e84f563-366e-4fc5-ad09-ab83e6f414af req-121d2ba1-75de-4f22-9515-8f1d2df1b01e service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:28.567903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-5e84f563-366e-4fc5-ad09-ab83e6f414af req-121d2ba1-75de-4f22-9515-8f1d2df1b01e service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:28.568340 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-5e84f563-366e-4fc5-ad09-ab83e6f414af req-121d2ba1-75de-4f22-9515-8f1d2df1b01e service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:28.588245 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-5e84f563-366e-4fc5-ad09-ab83e6f414af req-121d2ba1-75de-4f22-9515-8f1d2df1b01e service nova] Creating event network-changed:6f7538a1-11a6-4fe2-a404-3fe6642cb47c for instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 on hv-cinder-85272 Aug 10 17:20:28.596071 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-5e84f563-366e-4fc5-ad09-ab83e6f414af req-121d2ba1-75de-4f22-9515-8f1d2df1b01e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043405 Aug 10 17:20:28.597778 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 430/848] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:29.401025 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6f5d8b89-2a2e-4d18-b7f3-3689b8f67d1c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:29.401731 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6f5d8b89-2a2e-4d18-b7f3-3689b8f67d1c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:29.408445 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6f5d8b89-2a2e-4d18-b7f3-3689b8f67d1c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:29.408938 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6f5d8b89-2a2e-4d18-b7f3-3689b8f67d1c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:29.412648 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6f5d8b89-2a2e-4d18-b7f3-3689b8f67d1c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:29.412648 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6f5d8b89-2a2e-4d18-b7f3-3689b8f67d1c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:29.412648 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6f5d8b89-2a2e-4d18-b7f3-3689b8f67d1c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:29.412648 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6f5d8b89-2a2e-4d18-b7f3-3689b8f67d1c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:29.415152 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:20:29.548440 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6f5d8b89-2a2e-4d18-b7f3-3689b8f67d1c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:29.555761 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6f5d8b89-2a2e-4d18-b7f3-3689b8f67d1c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1367 microversion: 2.1 time: 0.158975 Aug 10 17:20:29.556323 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 419/849] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:29 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:29.939894 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3f986b9c-d187-41ad-8033-1dbddadf6626 tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] Calling method '.version_select at 0x7f7eb9eb00d0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:29.987831 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3f986b9c-d187-41ad-8033-1dbddadf6626 tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/cef38344-1c1e-41a5-af34-a03ffa4a8a74" status: 200 len: 351 microversion: 2.1 time: 0.052027 Aug 10 17:20:29.988401 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 431/850] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:20:29 2022] GET /compute/v2.1/os-volumes/cef38344-1c1e-41a5-af34-a03ffa4a8a74 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:30.578013 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6949f8e2-eae9-47dc-a7d8-31e1ade089f2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:30.578708 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6949f8e2-eae9-47dc-a7d8-31e1ade089f2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:30.586022 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6949f8e2-eae9-47dc-a7d8-31e1ade089f2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:30.586552 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6949f8e2-eae9-47dc-a7d8-31e1ade089f2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:30.586989 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6949f8e2-eae9-47dc-a7d8-31e1ade089f2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:30.587885 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6949f8e2-eae9-47dc-a7d8-31e1ade089f2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:30.588341 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6949f8e2-eae9-47dc-a7d8-31e1ade089f2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:30.588762 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6949f8e2-eae9-47dc-a7d8-31e1ade089f2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:30.726364 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6949f8e2-eae9-47dc-a7d8-31e1ade089f2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:30.733758 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6949f8e2-eae9-47dc-a7d8-31e1ade089f2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1367 microversion: 2.1 time: 0.160500 Aug 10 17:20:30.734258 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 420/851] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:30 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:31.610292 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-19922cc3-1f1c-4e57-8d90-ced82640f70f tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] Calling method '.version_select at 0x7f7eb9e35700>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:31.657771 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-19922cc3-1f1c-4e57-8d90-ced82640f70f tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e23c1c14-05cb-49da-a062-ead0721c0293" status: 200 len: 350 microversion: 2.1 time: 0.052199 Aug 10 17:20:31.658428 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 432/852] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:20:31 2022] GET /compute/v2.1/os-volumes/e23c1c14-05cb-49da-a062-ead0721c0293 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:31.754445 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f3073116-0758-4696-af98-15e7e21d2f0f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:31.755060 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f3073116-0758-4696-af98-15e7e21d2f0f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:31.761716 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3073116-0758-4696-af98-15e7e21d2f0f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:31.762203 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3073116-0758-4696-af98-15e7e21d2f0f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:31.762703 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3073116-0758-4696-af98-15e7e21d2f0f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:31.763418 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3073116-0758-4696-af98-15e7e21d2f0f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:31.763903 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3073116-0758-4696-af98-15e7e21d2f0f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:31.764529 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3073116-0758-4696-af98-15e7e21d2f0f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:31.908660 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f3073116-0758-4696-af98-15e7e21d2f0f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:31.916086 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f3073116-0758-4696-af98-15e7e21d2f0f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1367 microversion: 2.1 time: 0.165554 Aug 10 17:20:31.916652 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 421/853] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:31 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:32.938807 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c09df3a5-d368-4ed2-8c67-f7c9e9e849ea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:32.939651 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c09df3a5-d368-4ed2-8c67-f7c9e9e849ea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:32.948354 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c09df3a5-d368-4ed2-8c67-f7c9e9e849ea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:32.948850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c09df3a5-d368-4ed2-8c67-f7c9e9e849ea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:32.949303 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c09df3a5-d368-4ed2-8c67-f7c9e9e849ea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:32.950017 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c09df3a5-d368-4ed2-8c67-f7c9e9e849ea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:32.950510 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c09df3a5-d368-4ed2-8c67-f7c9e9e849ea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:32.950942 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c09df3a5-d368-4ed2-8c67-f7c9e9e849ea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:33.085402 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c09df3a5-d368-4ed2-8c67-f7c9e9e849ea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:33.093544 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c09df3a5-d368-4ed2-8c67-f7c9e9e849ea tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1367 microversion: 2.1 time: 0.160333 Aug 10 17:20:33.095255 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 433/854] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:32 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:33.424904 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-99775da8-c568-44d0-8b7d-50e64551d2ed tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] Calling method '.version_select at 0x7f7eb9e5d1f0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:33.472745 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-99775da8-c568-44d0-8b7d-50e64551d2ed tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/d636e92b-3132-41f2-8edf-ccab199a5e23" status: 200 len: 351 microversion: 2.1 time: 0.051692 Aug 10 17:20:33.473345 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 422/855] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 17:20:33 2022] GET /compute/v2.1/os-volumes/d636e92b-3132-41f2-8edf-ccab199a5e23 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:33.485826 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-16c09d71-69e9-44fe-a642-42e26f3e8ef7 tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] Calling method '.version_select at 0x7f7eb9ec7430>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:33.519894 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:20:33.540949 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=10 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:20:33.570981 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-16c09d71-69e9-44fe-a642-42e26f3e8ef7 tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089003 Aug 10 17:20:33.571550 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 434/856] 10.222.0.45 () {58 vars in 1134 bytes} [Wed Aug 10 17:20:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:33.585598 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-992b8492-081a-49cc-8676-28277e37af08 tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] Calling method '.version_select at 0x7f7eb9e74ca0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:33.673831 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-992b8492-081a-49cc-8676-28277e37af08 tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088850 Aug 10 17:20:33.673831 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 423/857] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Aug 10 17:20:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:33.685372 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-825e56a2-d26d-4f32-a22c-56286243746e tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] Calling method '.version_select at 0x7f7eb9e84310>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:33.770796 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-825e56a2-d26d-4f32-a22c-56286243746e tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089715 Aug 10 17:20:33.771368 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 435/858] 10.222.0.45 () {58 vars in 1134 bytes} [Wed Aug 10 17:20:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:33.783938 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2a0d6d7d-c28b-4196-9775-50d07ae89f70 tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] Calling method '.version_select at 0x7f7eb9e65dc0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:33.802936 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:20:33.868057 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2a0d6d7d-c28b-4196-9775-50d07ae89f70 tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087912 Aug 10 17:20:33.868704 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 424/859] 10.222.0.45 () {58 vars in 1167 bytes} [Wed Aug 10 17:20:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:33.882169 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-33c2f125-5eea-46fe-9b7a-01807caebac3 tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] Calling method '.version_select at 0x7f7eb9e37040>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:33.965707 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-33c2f125-5eea-46fe-9b7a-01807caebac3 tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087304 Aug 10 17:20:33.966333 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 436/860] 10.222.0.45 () {58 vars in 1170 bytes} [Wed Aug 10 17:20:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:33.979543 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d5d9d1a5-a762-40d1-9f36-aafeaa5401ad tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] Calling method '.version_select at 0x7f7eb9ec94c0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:34.060081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d5d9d1a5-a762-40d1-9f36-aafeaa5401ad tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084601 Aug 10 17:20:34.061160 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 425/861] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Aug 10 17:20:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:34.073841 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c3c6276b-97a8-42b5-83e8-a4a646bd0a1d tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] Calling method '.version_select at 0x7f7eba0201f0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:34.114570 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4e427c69-f1c6-4077-9757-9743d033c485 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:34.115181 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4e427c69-f1c6-4077-9757-9743d033c485 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:34.121324 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e427c69-f1c6-4077-9757-9743d033c485 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:34.121741 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e427c69-f1c6-4077-9757-9743d033c485 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:34.122171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e427c69-f1c6-4077-9757-9743d033c485 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:34.122892 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e427c69-f1c6-4077-9757-9743d033c485 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:34.124011 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e427c69-f1c6-4077-9757-9743d033c485 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:34.124426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e427c69-f1c6-4077-9757-9743d033c485 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:34.156207 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c3c6276b-97a8-42b5-83e8-a4a646bd0a1d tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086086 Aug 10 17:20:34.156787 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 437/862] 10.222.0.45 () {58 vars in 1188 bytes} [Wed Aug 10 17:20:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:34.169445 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2268ca08-2bc8-429d-93e8-b958bae34993 tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] Calling method '.version_select at 0x7f7eb9fd1f70>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:34.252191 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2268ca08-2bc8-429d-93e8-b958bae34993 tempest-VolumesTestJSON-1235786600 tempest-VolumesTestJSON-1235786600-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086420 Aug 10 17:20:34.252768 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 438/863] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Aug 10 17:20:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:20:34.257077 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4e427c69-f1c6-4077-9757-9743d033c485 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:34.265099 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4e427c69-f1c6-4077-9757-9743d033c485 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1367 microversion: 2.1 time: 0.154347 Aug 10 17:20:34.265759 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 426/864] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:34 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:20:35.183902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-145ca485-8a0e-443c-9e38-5645df95b849 req-cee8ce04-dee2-48a3-9c81-10a8d949e174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d76607cf-e08a-4b20-8edb-4fef90a17fb9", "name": "network-vif-plugged", "status": "completed", "tag": "6f7538a1-11a6-4fe2-a404-3fe6642cb47c"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:35.195902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-145ca485-8a0e-443c-9e38-5645df95b849 req-cee8ce04-dee2-48a3-9c81-10a8d949e174 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:35.196401 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-145ca485-8a0e-443c-9e38-5645df95b849 req-cee8ce04-dee2-48a3-9c81-10a8d949e174 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:35.196829 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-145ca485-8a0e-443c-9e38-5645df95b849 req-cee8ce04-dee2-48a3-9c81-10a8d949e174 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:35.207970 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-145ca485-8a0e-443c-9e38-5645df95b849 req-cee8ce04-dee2-48a3-9c81-10a8d949e174 service nova] Creating event network-vif-plugged:6f7538a1-11a6-4fe2-a404-3fe6642cb47c for instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 on hv-cinder-85272 Aug 10 17:20:35.213079 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-145ca485-8a0e-443c-9e38-5645df95b849 req-cee8ce04-dee2-48a3-9c81-10a8d949e174 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149949 Aug 10 17:20:35.213674 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 439/865] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:35.289643 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6c5a1b7d-6b78-4f5a-93f8-72eaa7f1c911 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:35.290294 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6c5a1b7d-6b78-4f5a-93f8-72eaa7f1c911 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:35.297737 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5a1b7d-6b78-4f5a-93f8-72eaa7f1c911 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:35.298230 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5a1b7d-6b78-4f5a-93f8-72eaa7f1c911 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:35.298701 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5a1b7d-6b78-4f5a-93f8-72eaa7f1c911 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:35.299410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5a1b7d-6b78-4f5a-93f8-72eaa7f1c911 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:35.299864 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5a1b7d-6b78-4f5a-93f8-72eaa7f1c911 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:35.300280 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5a1b7d-6b78-4f5a-93f8-72eaa7f1c911 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:35.440335 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6c5a1b7d-6b78-4f5a-93f8-72eaa7f1c911 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:35.447833 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6c5a1b7d-6b78-4f5a-93f8-72eaa7f1c911 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1367 microversion: 2.1 time: 0.166011 Aug 10 17:20:35.448390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 427/866] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:35 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:36.469935 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-00ea5c8e-b9c4-488a-918a-bf406024d7d8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:36.470603 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-00ea5c8e-b9c4-488a-918a-bf406024d7d8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:36.476730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00ea5c8e-b9c4-488a-918a-bf406024d7d8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:36.477217 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00ea5c8e-b9c4-488a-918a-bf406024d7d8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:36.481409 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00ea5c8e-b9c4-488a-918a-bf406024d7d8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:36.481409 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00ea5c8e-b9c4-488a-918a-bf406024d7d8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:36.481409 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00ea5c8e-b9c4-488a-918a-bf406024d7d8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:36.481409 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00ea5c8e-b9c4-488a-918a-bf406024d7d8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:36.615261 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-00ea5c8e-b9c4-488a-918a-bf406024d7d8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:36.622841 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-00ea5c8e-b9c4-488a-918a-bf406024d7d8 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1367 microversion: 2.1 time: 0.158254 Aug 10 17:20:36.624083 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 440/867] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:36 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:37.644979 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6224b066-dabf-47e1-b4e5-3cd8368a2d5c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:37.645593 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6224b066-dabf-47e1-b4e5-3cd8368a2d5c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:37.651965 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6224b066-dabf-47e1-b4e5-3cd8368a2d5c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:37.653201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6224b066-dabf-47e1-b4e5-3cd8368a2d5c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:37.653201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6224b066-dabf-47e1-b4e5-3cd8368a2d5c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:37.653579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6224b066-dabf-47e1-b4e5-3cd8368a2d5c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:37.654039 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6224b066-dabf-47e1-b4e5-3cd8368a2d5c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:37.654498 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6224b066-dabf-47e1-b4e5-3cd8368a2d5c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:37.790739 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6224b066-dabf-47e1-b4e5-3cd8368a2d5c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:37.798997 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6224b066-dabf-47e1-b4e5-3cd8368a2d5c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1556 microversion: 2.1 time: 0.158512 Aug 10 17:20:37.799570 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 428/868] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:20:37 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:20:37.820335 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a129d0c1-af88-402f-b95a-5a43abec3500 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:37.820891 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a129d0c1-af88-402f-b95a-5a43abec3500 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:37.827361 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a129d0c1-af88-402f-b95a-5a43abec3500 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:37.828422 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a129d0c1-af88-402f-b95a-5a43abec3500 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:37.828865 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a129d0c1-af88-402f-b95a-5a43abec3500 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:37.829561 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a129d0c1-af88-402f-b95a-5a43abec3500 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:37.830013 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a129d0c1-af88-402f-b95a-5a43abec3500 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:37.830464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a129d0c1-af88-402f-b95a-5a43abec3500 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:37.911287 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a129d0c1-af88-402f-b95a-5a43abec3500 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094676 Aug 10 17:20:37.911968 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 441/869] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 17:20:37 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:38.927315 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-ebc4c1fd-163b-455a-9e73-dec9aaf1593c req-0743043a-d805-4fe4-862d-571b9015292b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d76607cf-e08a-4b20-8edb-4fef90a17fb9", "tag": "6f7538a1-11a6-4fe2-a404-3fe6642cb47c"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:38.938051 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-ebc4c1fd-163b-455a-9e73-dec9aaf1593c req-0743043a-d805-4fe4-862d-571b9015292b service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:38.938647 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-ebc4c1fd-163b-455a-9e73-dec9aaf1593c req-0743043a-d805-4fe4-862d-571b9015292b service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:38.939137 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-ebc4c1fd-163b-455a-9e73-dec9aaf1593c req-0743043a-d805-4fe4-862d-571b9015292b service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:38.951437 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-ebc4c1fd-163b-455a-9e73-dec9aaf1593c req-0743043a-d805-4fe4-862d-571b9015292b service nova] Creating event network-changed:6f7538a1-11a6-4fe2-a404-3fe6642cb47c for instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 on hv-cinder-85272 Aug 10 17:20:38.957926 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-ebc4c1fd-163b-455a-9e73-dec9aaf1593c req-0743043a-d805-4fe4-862d-571b9015292b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034279 Aug 10 17:20:38.959002 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 429/870] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:40.364598 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d965efae-6ef8-4f63-9961-f4284390dddf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:40.365129 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d965efae-6ef8-4f63-9961-f4284390dddf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:40.370983 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d965efae-6ef8-4f63-9961-f4284390dddf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:40.371470 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d965efae-6ef8-4f63-9961-f4284390dddf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:40.371910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d965efae-6ef8-4f63-9961-f4284390dddf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:40.372613 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d965efae-6ef8-4f63-9961-f4284390dddf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:40.373068 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d965efae-6ef8-4f63-9961-f4284390dddf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:40.373501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d965efae-6ef8-4f63-9961-f4284390dddf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:40.397049 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d965efae-6ef8-4f63-9961-f4284390dddf tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/ips" status: 200 len: 144 microversion: 2.1 time: 0.036836 Aug 10 17:20:40.397651 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 442/871] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 17:20:40 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:41.846012 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-97bff4dd-8453-4eed-b0e2-1f4aecda1c65 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:41.846634 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-97bff4dd-8453-4eed-b0e2-1f4aecda1c65 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:41.853745 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-97bff4dd-8453-4eed-b0e2-1f4aecda1c65 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:41.854236 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-97bff4dd-8453-4eed-b0e2-1f4aecda1c65 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:41.854707 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-97bff4dd-8453-4eed-b0e2-1f4aecda1c65 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:41.855486 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-97bff4dd-8453-4eed-b0e2-1f4aecda1c65 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:41.856585 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-97bff4dd-8453-4eed-b0e2-1f4aecda1c65 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:41.857023 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-97bff4dd-8453-4eed-b0e2-1f4aecda1c65 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:41.880695 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-97bff4dd-8453-4eed-b0e2-1f4aecda1c65 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1/ips" status: 200 len: 151 microversion: 2.20 time: 0.039502 Aug 10 17:20:41.887350 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 430/872] 10.222.0.45 () {60 vars in 1289 bytes} [Wed Aug 10 17:20:41 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 17:20:42.202975 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-599564a2-b5f3-4632-b946-032ba74fe82a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a7bd50e-9b28-4ac5-ac77-57d8c596e5b8"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:42.206469 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-599564a2-b5f3-4632-b946-032ba74fe82a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:42.212149 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-599564a2-b5f3-4632-b946-032ba74fe82a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:42.212642 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-599564a2-b5f3-4632-b946-032ba74fe82a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:42.213085 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-599564a2-b5f3-4632-b946-032ba74fe82a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:42.213821 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-599564a2-b5f3-4632-b946-032ba74fe82a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:42.214291 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-599564a2-b5f3-4632-b946-032ba74fe82a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:42.214743 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-599564a2-b5f3-4632-b946-032ba74fe82a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:42.492002 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:20:43.222800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-599564a2-b5f3-4632-b946-032ba74fe82a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "POST /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.024115 Aug 10 17:20:43.223498 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 443/873] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 17:20:42 2022] POST /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments => generated 194 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:20:44.541406 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d762946e-28a1-439c-bd3f-469727e933f4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:44.541960 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d762946e-28a1-439c-bd3f-469727e933f4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:44.550018 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d762946e-28a1-439c-bd3f-469727e933f4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:44.550484 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d762946e-28a1-439c-bd3f-469727e933f4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:44.550925 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d762946e-28a1-439c-bd3f-469727e933f4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:44.551621 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d762946e-28a1-439c-bd3f-469727e933f4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:44.552082 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d762946e-28a1-439c-bd3f-469727e933f4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:44.552517 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d762946e-28a1-439c-bd3f-469727e933f4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:44.577313 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-d762946e-28a1-439c-bd3f-469727e933f4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lazy-loading 'flavor' on Instance uuid 1c7eaaa8-2f20-4c87-a62a-e855728effb1 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:20:45.165007 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d762946e-28a1-439c-bd3f-469727e933f4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "POST /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1/action" status: 202 len: 0 microversion: 2.20 time: 0.624635 Aug 10 17:20:45.165007 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 431/874] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 10 17:20:44 2022] POST /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:20:45.173753 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6ed2212b-c077-4550-b6db-f01bd7154f2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:45.174504 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6ed2212b-c077-4550-b6db-f01bd7154f2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:45.185351 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ed2212b-c077-4550-b6db-f01bd7154f2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:45.185901 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ed2212b-c077-4550-b6db-f01bd7154f2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:45.186483 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ed2212b-c077-4550-b6db-f01bd7154f2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:45.187610 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ed2212b-c077-4550-b6db-f01bd7154f2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:45.188174 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ed2212b-c077-4550-b6db-f01bd7154f2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:45.188786 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ed2212b-c077-4550-b6db-f01bd7154f2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:45.326667 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6ed2212b-c077-4550-b6db-f01bd7154f2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:45.335429 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6ed2212b-c077-4550-b6db-f01bd7154f2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:45.336896 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6ed2212b-c077-4550-b6db-f01bd7154f2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:45.338091 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6ed2212b-c077-4550-b6db-f01bd7154f2a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.170297 Aug 10 17:20:45.338689 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 444/875] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:45 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:20:46.365574 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e086f268-df0d-48ba-9680-85137f6d1514 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:46.366383 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e086f268-df0d-48ba-9680-85137f6d1514 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:46.375133 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e086f268-df0d-48ba-9680-85137f6d1514 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:46.375626 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e086f268-df0d-48ba-9680-85137f6d1514 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:46.376065 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e086f268-df0d-48ba-9680-85137f6d1514 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:46.376766 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e086f268-df0d-48ba-9680-85137f6d1514 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:46.377253 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e086f268-df0d-48ba-9680-85137f6d1514 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:46.377679 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e086f268-df0d-48ba-9680-85137f6d1514 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:46.513992 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e086f268-df0d-48ba-9680-85137f6d1514 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:46.523360 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e086f268-df0d-48ba-9680-85137f6d1514 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:46.524920 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e086f268-df0d-48ba-9680-85137f6d1514 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:46.526093 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e086f268-df0d-48ba-9680-85137f6d1514 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.167084 Aug 10 17:20:46.526700 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 432/876] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:46 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:20:47.549142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4a171b72-030a-472a-ba37-64a4cce66dc5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:47.549756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4a171b72-030a-472a-ba37-64a4cce66dc5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:47.556619 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a171b72-030a-472a-ba37-64a4cce66dc5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:47.557110 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a171b72-030a-472a-ba37-64a4cce66dc5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:47.557559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a171b72-030a-472a-ba37-64a4cce66dc5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:47.558258 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a171b72-030a-472a-ba37-64a4cce66dc5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:47.558743 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a171b72-030a-472a-ba37-64a4cce66dc5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:47.559176 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a171b72-030a-472a-ba37-64a4cce66dc5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:47.690968 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4a171b72-030a-472a-ba37-64a4cce66dc5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:47.699007 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4a171b72-030a-472a-ba37-64a4cce66dc5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:47.700534 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4a171b72-030a-472a-ba37-64a4cce66dc5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:47.701723 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4a171b72-030a-472a-ba37-64a4cce66dc5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.157195 Aug 10 17:20:47.702276 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 445/877] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:47 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:20:48.725896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-820953ae-573d-40a4-82f1-6ac8ac6b7c80 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:48.726644 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-820953ae-573d-40a4-82f1-6ac8ac6b7c80 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:48.734558 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-820953ae-573d-40a4-82f1-6ac8ac6b7c80 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:48.742897 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-820953ae-573d-40a4-82f1-6ac8ac6b7c80 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:48.742897 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-820953ae-573d-40a4-82f1-6ac8ac6b7c80 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:48.742897 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-820953ae-573d-40a4-82f1-6ac8ac6b7c80 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:48.742897 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-820953ae-573d-40a4-82f1-6ac8ac6b7c80 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:48.743205 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-820953ae-573d-40a4-82f1-6ac8ac6b7c80 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:48.877455 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-820953ae-573d-40a4-82f1-6ac8ac6b7c80 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:48.885741 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-820953ae-573d-40a4-82f1-6ac8ac6b7c80 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:48.887280 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-820953ae-573d-40a4-82f1-6ac8ac6b7c80 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:48.888436 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-820953ae-573d-40a4-82f1-6ac8ac6b7c80 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.166934 Aug 10 17:20:48.888991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 433/878] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:48 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:20:49.911542 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ac19c1c2-3434-42e6-b370-e8c251419aa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:49.912161 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ac19c1c2-3434-42e6-b370-e8c251419aa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:49.918642 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac19c1c2-3434-42e6-b370-e8c251419aa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:49.919131 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac19c1c2-3434-42e6-b370-e8c251419aa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:49.919576 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac19c1c2-3434-42e6-b370-e8c251419aa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:49.920263 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac19c1c2-3434-42e6-b370-e8c251419aa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:49.920720 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac19c1c2-3434-42e6-b370-e8c251419aa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:49.921147 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac19c1c2-3434-42e6-b370-e8c251419aa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:50.052869 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ac19c1c2-3434-42e6-b370-e8c251419aa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:50.060748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ac19c1c2-3434-42e6-b370-e8c251419aa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:50.062252 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ac19c1c2-3434-42e6-b370-e8c251419aa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:50.063433 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ac19c1c2-3434-42e6-b370-e8c251419aa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.155791 Aug 10 17:20:50.063982 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 446/879] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:49 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:20:51.087088 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ea3c7884-03b5-4f84-9c0e-bd166da739e8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:51.087738 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ea3c7884-03b5-4f84-9c0e-bd166da739e8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:51.094664 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea3c7884-03b5-4f84-9c0e-bd166da739e8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:51.095149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea3c7884-03b5-4f84-9c0e-bd166da739e8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:51.095581 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea3c7884-03b5-4f84-9c0e-bd166da739e8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:51.096271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea3c7884-03b5-4f84-9c0e-bd166da739e8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:51.096759 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea3c7884-03b5-4f84-9c0e-bd166da739e8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:51.097179 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea3c7884-03b5-4f84-9c0e-bd166da739e8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:51.272843 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ea3c7884-03b5-4f84-9c0e-bd166da739e8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:51.283270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ea3c7884-03b5-4f84-9c0e-bd166da739e8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:51.284754 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ea3c7884-03b5-4f84-9c0e-bd166da739e8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:51.286048 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ea3c7884-03b5-4f84-9c0e-bd166da739e8 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.202957 Aug 10 17:20:51.287022 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 434/880] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:51 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:20:51.836727 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-51888452-0e93-4c6d-bf62-c8aa9641780c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:51.839036 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-51888452-0e93-4c6d-bf62-c8aa9641780c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:51.845655 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-51888452-0e93-4c6d-bf62-c8aa9641780c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:51.846144 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-51888452-0e93-4c6d-bf62-c8aa9641780c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:51.846612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-51888452-0e93-4c6d-bf62-c8aa9641780c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:51.847328 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-51888452-0e93-4c6d-bf62-c8aa9641780c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:51.847769 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-51888452-0e93-4c6d-bf62-c8aa9641780c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:51.848198 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-51888452-0e93-4c6d-bf62-c8aa9641780c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:51.878642 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-51888452-0e93-4c6d-bf62-c8aa9641780c tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045626 Aug 10 17:20:51.879213 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 447/881] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:20:51 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:51.890928 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-271e5ab2-4f3d-411a-b855-2a3703188a32 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:51.891426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-271e5ab2-4f3d-411a-b855-2a3703188a32 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:51.897609 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-271e5ab2-4f3d-411a-b855-2a3703188a32 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:51.898097 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-271e5ab2-4f3d-411a-b855-2a3703188a32 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:51.898573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-271e5ab2-4f3d-411a-b855-2a3703188a32 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:51.899392 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-271e5ab2-4f3d-411a-b855-2a3703188a32 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:51.899797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-271e5ab2-4f3d-411a-b855-2a3703188a32 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:51.900216 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-271e5ab2-4f3d-411a-b855-2a3703188a32 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:51.929003 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-271e5ab2-4f3d-411a-b855-2a3703188a32 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments/1a7bd50e-9b28-4ac5-ac77-57d8c596e5b8" status: 200 len: 194 microversion: 2.1 time: 0.042652 Aug 10 17:20:51.929621 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 435/882] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Aug 10 17:20:51 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments/1a7bd50e-9b28-4ac5-ac77-57d8c596e5b8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:52.309306 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4d59a116-a8b6-470d-ab33-17a7fa155e71 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:52.313531 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4d59a116-a8b6-470d-ab33-17a7fa155e71 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:52.316779 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d59a116-a8b6-470d-ab33-17a7fa155e71 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:52.317447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d59a116-a8b6-470d-ab33-17a7fa155e71 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:52.317898 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d59a116-a8b6-470d-ab33-17a7fa155e71 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:52.318634 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d59a116-a8b6-470d-ab33-17a7fa155e71 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:52.319091 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d59a116-a8b6-470d-ab33-17a7fa155e71 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:52.319517 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4d59a116-a8b6-470d-ab33-17a7fa155e71 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:52.463968 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4d59a116-a8b6-470d-ab33-17a7fa155e71 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:52.472964 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4d59a116-a8b6-470d-ab33-17a7fa155e71 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:52.474459 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4d59a116-a8b6-470d-ab33-17a7fa155e71 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:52.475614 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4d59a116-a8b6-470d-ab33-17a7fa155e71 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.170308 Aug 10 17:20:52.476170 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 448/883] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:52 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:20:53.499634 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8164971d-9e4e-46f9-af30-cd8d8152c35a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:53.500532 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8164971d-9e4e-46f9-af30-cd8d8152c35a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:53.506443 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8164971d-9e4e-46f9-af30-cd8d8152c35a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:53.506993 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8164971d-9e4e-46f9-af30-cd8d8152c35a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:53.507423 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8164971d-9e4e-46f9-af30-cd8d8152c35a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:53.508387 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8164971d-9e4e-46f9-af30-cd8d8152c35a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:53.508851 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8164971d-9e4e-46f9-af30-cd8d8152c35a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:53.509281 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8164971d-9e4e-46f9-af30-cd8d8152c35a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:53.647597 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8164971d-9e4e-46f9-af30-cd8d8152c35a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:53.656358 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8164971d-9e4e-46f9-af30-cd8d8152c35a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:53.657874 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8164971d-9e4e-46f9-af30-cd8d8152c35a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:53.659074 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8164971d-9e4e-46f9-af30-cd8d8152c35a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.163903 Aug 10 17:20:53.659635 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 436/884] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:53 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:20:53.757040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3ada514c-27eb-4e33-969e-9ba472b3afa6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ae1aae3-df3b-49d7-843f-00e829a2410f"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:20:53.760088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3ada514c-27eb-4e33-969e-9ba472b3afa6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:53.767090 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ada514c-27eb-4e33-969e-9ba472b3afa6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:53.767570 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ada514c-27eb-4e33-969e-9ba472b3afa6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:53.768197 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ada514c-27eb-4e33-969e-9ba472b3afa6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:53.768689 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ada514c-27eb-4e33-969e-9ba472b3afa6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:53.769141 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ada514c-27eb-4e33-969e-9ba472b3afa6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:53.769675 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ada514c-27eb-4e33-969e-9ba472b3afa6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:54.685818 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-10f57cb1-03fb-41e0-b000-13f93203ddab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:54.686495 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-10f57cb1-03fb-41e0-b000-13f93203ddab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:54.693823 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10f57cb1-03fb-41e0-b000-13f93203ddab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:54.694419 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10f57cb1-03fb-41e0-b000-13f93203ddab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:54.694930 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10f57cb1-03fb-41e0-b000-13f93203ddab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:54.695797 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10f57cb1-03fb-41e0-b000-13f93203ddab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:54.696328 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10f57cb1-03fb-41e0-b000-13f93203ddab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:54.696843 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10f57cb1-03fb-41e0-b000-13f93203ddab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:54.786499 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3ada514c-27eb-4e33-969e-9ba472b3afa6 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "POST /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.032817 Aug 10 17:20:54.787712 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 449/885] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 17:20:53 2022] POST /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments => generated 194 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:20:54.843538 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-10f57cb1-03fb-41e0-b000-13f93203ddab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:54.857060 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-10f57cb1-03fb-41e0-b000-13f93203ddab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:54.857060 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-10f57cb1-03fb-41e0-b000-13f93203ddab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:54.857060 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-10f57cb1-03fb-41e0-b000-13f93203ddab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.174448 Aug 10 17:20:54.857825 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 437/886] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:54 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:20:55.881666 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-15ee81cb-2bf3-408d-a1ab-3e29dec6472c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:55.882935 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-15ee81cb-2bf3-408d-a1ab-3e29dec6472c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:55.889515 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15ee81cb-2bf3-408d-a1ab-3e29dec6472c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:55.891459 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15ee81cb-2bf3-408d-a1ab-3e29dec6472c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:55.891921 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15ee81cb-2bf3-408d-a1ab-3e29dec6472c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:55.892626 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15ee81cb-2bf3-408d-a1ab-3e29dec6472c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:55.893134 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15ee81cb-2bf3-408d-a1ab-3e29dec6472c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:55.893557 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15ee81cb-2bf3-408d-a1ab-3e29dec6472c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:56.044871 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-15ee81cb-2bf3-408d-a1ab-3e29dec6472c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:56.053744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-15ee81cb-2bf3-408d-a1ab-3e29dec6472c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:56.055316 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-15ee81cb-2bf3-408d-a1ab-3e29dec6472c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:56.056467 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-15ee81cb-2bf3-408d-a1ab-3e29dec6472c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.180767 Aug 10 17:20:56.057015 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 450/887] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:55 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:20:57.080715 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7fc84afe-ff26-4535-ab73-cf9b669c73a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:57.081383 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7fc84afe-ff26-4535-ab73-cf9b669c73a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:57.088022 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7fc84afe-ff26-4535-ab73-cf9b669c73a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:57.088506 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7fc84afe-ff26-4535-ab73-cf9b669c73a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:57.088944 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7fc84afe-ff26-4535-ab73-cf9b669c73a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:57.089707 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7fc84afe-ff26-4535-ab73-cf9b669c73a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:57.090160 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7fc84afe-ff26-4535-ab73-cf9b669c73a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:57.090611 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7fc84afe-ff26-4535-ab73-cf9b669c73a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:57.374386 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7fc84afe-ff26-4535-ab73-cf9b669c73a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:57.379070 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:20:57.384792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7fc84afe-ff26-4535-ab73-cf9b669c73a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:57.386339 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7fc84afe-ff26-4535-ab73-cf9b669c73a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:57.387596 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7fc84afe-ff26-4535-ab73-cf9b669c73a6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.311489 Aug 10 17:20:57.388176 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 438/888] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:57 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:20:58.414623 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-65e3cd4a-2926-4d8d-a42f-ce566e7b09ff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:58.415205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-65e3cd4a-2926-4d8d-a42f-ce566e7b09ff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:58.421519 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65e3cd4a-2926-4d8d-a42f-ce566e7b09ff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:58.422016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65e3cd4a-2926-4d8d-a42f-ce566e7b09ff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:58.422504 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65e3cd4a-2926-4d8d-a42f-ce566e7b09ff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:58.423248 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65e3cd4a-2926-4d8d-a42f-ce566e7b09ff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:58.423782 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65e3cd4a-2926-4d8d-a42f-ce566e7b09ff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:58.424216 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65e3cd4a-2926-4d8d-a42f-ce566e7b09ff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:58.557001 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-65e3cd4a-2926-4d8d-a42f-ce566e7b09ff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:58.566341 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-65e3cd4a-2926-4d8d-a42f-ce566e7b09ff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:58.567880 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-65e3cd4a-2926-4d8d-a42f-ce566e7b09ff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:58.569025 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-65e3cd4a-2926-4d8d-a42f-ce566e7b09ff tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.158822 Aug 10 17:20:58.569574 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 451/889] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:58 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:20:59.593217 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-26f1796e-6ecf-4d34-adc3-ef299937ae73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:20:59.594084 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-26f1796e-6ecf-4d34-adc3-ef299937ae73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:20:59.601688 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26f1796e-6ecf-4d34-adc3-ef299937ae73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:59.602806 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26f1796e-6ecf-4d34-adc3-ef299937ae73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:59.602806 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26f1796e-6ecf-4d34-adc3-ef299937ae73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:59.603459 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26f1796e-6ecf-4d34-adc3-ef299937ae73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:20:59.603909 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26f1796e-6ecf-4d34-adc3-ef299937ae73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:20:59.604344 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26f1796e-6ecf-4d34-adc3-ef299937ae73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:20:59.752789 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-26f1796e-6ecf-4d34-adc3-ef299937ae73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:59.761641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-26f1796e-6ecf-4d34-adc3-ef299937ae73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:59.763192 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-26f1796e-6ecf-4d34-adc3-ef299937ae73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:20:59.764428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-26f1796e-6ecf-4d34-adc3-ef299937ae73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.175315 Aug 10 17:20:59.764996 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 439/890] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:20:59 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:00.788487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-29705cb4-cff4-41ea-8c5f-e1c8b9ceaad6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:00.789038 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-29705cb4-cff4-41ea-8c5f-e1c8b9ceaad6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:00.795639 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29705cb4-cff4-41ea-8c5f-e1c8b9ceaad6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:00.801549 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29705cb4-cff4-41ea-8c5f-e1c8b9ceaad6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:00.801549 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29705cb4-cff4-41ea-8c5f-e1c8b9ceaad6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:00.801549 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29705cb4-cff4-41ea-8c5f-e1c8b9ceaad6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:00.801549 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29705cb4-cff4-41ea-8c5f-e1c8b9ceaad6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:00.801927 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29705cb4-cff4-41ea-8c5f-e1c8b9ceaad6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:00.933808 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-29705cb4-cff4-41ea-8c5f-e1c8b9ceaad6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:00.942397 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-29705cb4-cff4-41ea-8c5f-e1c8b9ceaad6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:00.943883 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-29705cb4-cff4-41ea-8c5f-e1c8b9ceaad6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:00.945033 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-29705cb4-cff4-41ea-8c5f-e1c8b9ceaad6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.160707 Aug 10 17:21:00.945589 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 452/891] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:00 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:01.968897 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-30753c1c-b73c-4597-87bf-ef89ca6d0f66 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:01.969701 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-30753c1c-b73c-4597-87bf-ef89ca6d0f66 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:01.973002 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=36 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:21:01.978003 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30753c1c-b73c-4597-87bf-ef89ca6d0f66 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:01.978535 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30753c1c-b73c-4597-87bf-ef89ca6d0f66 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:01.978973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30753c1c-b73c-4597-87bf-ef89ca6d0f66 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:01.979698 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30753c1c-b73c-4597-87bf-ef89ca6d0f66 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:01.980157 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30753c1c-b73c-4597-87bf-ef89ca6d0f66 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:01.980633 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30753c1c-b73c-4597-87bf-ef89ca6d0f66 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:02.113490 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-30753c1c-b73c-4597-87bf-ef89ca6d0f66 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:02.121468 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-30753c1c-b73c-4597-87bf-ef89ca6d0f66 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:02.123021 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-30753c1c-b73c-4597-87bf-ef89ca6d0f66 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:02.124227 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-30753c1c-b73c-4597-87bf-ef89ca6d0f66 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1743 microversion: 2.20 time: 0.159661 Aug 10 17:21:02.124784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 440/892] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:01 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:03.148721 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-87bdf3d2-5af6-4339-a3be-fed89af08b1d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:03.149501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-87bdf3d2-5af6-4339-a3be-fed89af08b1d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:03.152051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=32 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:21:03.156824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87bdf3d2-5af6-4339-a3be-fed89af08b1d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:03.164167 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87bdf3d2-5af6-4339-a3be-fed89af08b1d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:03.164167 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87bdf3d2-5af6-4339-a3be-fed89af08b1d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:03.164167 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87bdf3d2-5af6-4339-a3be-fed89af08b1d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:03.164167 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87bdf3d2-5af6-4339-a3be-fed89af08b1d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:03.164717 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87bdf3d2-5af6-4339-a3be-fed89af08b1d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:03.299850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-87bdf3d2-5af6-4339-a3be-fed89af08b1d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:03.307811 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-87bdf3d2-5af6-4339-a3be-fed89af08b1d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:03.309533 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-87bdf3d2-5af6-4339-a3be-fed89af08b1d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:03.310748 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-87bdf3d2-5af6-4339-a3be-fed89af08b1d tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1743 microversion: 2.20 time: 0.165921 Aug 10 17:21:03.311262 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 453/893] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:03 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:03.386877 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5a05a575-96af-490c-aa36-825015d3d7f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:03.388998 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5a05a575-96af-490c-aa36-825015d3d7f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:03.396411 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a05a575-96af-490c-aa36-825015d3d7f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:03.396942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a05a575-96af-490c-aa36-825015d3d7f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:03.397377 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a05a575-96af-490c-aa36-825015d3d7f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:03.398083 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a05a575-96af-490c-aa36-825015d3d7f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:03.398580 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a05a575-96af-490c-aa36-825015d3d7f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:03.399065 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a05a575-96af-490c-aa36-825015d3d7f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:03.430114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5a05a575-96af-490c-aa36-825015d3d7f5 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047477 Aug 10 17:21:03.430722 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 441/894] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:21:03 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:03.574886 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e2ecd712-ea23-42b6-b357-8d28f6516c63 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:03.575377 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e2ecd712-ea23-42b6-b357-8d28f6516c63 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:03.588519 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2ecd712-ea23-42b6-b357-8d28f6516c63 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:03.589017 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2ecd712-ea23-42b6-b357-8d28f6516c63 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:03.589465 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2ecd712-ea23-42b6-b357-8d28f6516c63 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:03.590176 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2ecd712-ea23-42b6-b357-8d28f6516c63 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:03.590678 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2ecd712-ea23-42b6-b357-8d28f6516c63 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:03.591108 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2ecd712-ea23-42b6-b357-8d28f6516c63 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:03.775925 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e2ecd712-ea23-42b6-b357-8d28f6516c63 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments/1a7bd50e-9b28-4ac5-ac77-57d8c596e5b8" status: 200 len: 194 microversion: 2.1 time: 0.204888 Aug 10 17:21:03.776480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 454/895] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Aug 10 17:21:03 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments/1a7bd50e-9b28-4ac5-ac77-57d8c596e5b8 => generated 194 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:03.787610 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-55008b71-065f-4cff-afda-fe97be115483 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:03.788108 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-55008b71-065f-4cff-afda-fe97be115483 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:03.793996 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-55008b71-065f-4cff-afda-fe97be115483 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:03.794521 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-55008b71-065f-4cff-afda-fe97be115483 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:03.794963 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-55008b71-065f-4cff-afda-fe97be115483 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:03.795653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-55008b71-065f-4cff-afda-fe97be115483 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:03.796114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-55008b71-065f-4cff-afda-fe97be115483 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:03.796547 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-55008b71-065f-4cff-afda-fe97be115483 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:03.881800 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-55008b71-065f-4cff-afda-fe97be115483 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lazy-loading 'services' on Instance uuid 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:21:04.133388 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-55008b71-065f-4cff-afda-fe97be115483 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments/1a7bd50e-9b28-4ac5-ac77-57d8c596e5b8" status: 202 len: 0 microversion: 2.1 time: 0.349853 Aug 10 17:21:04.134192 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 442/896] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 17:21:03 2022] DELETE /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments/1a7bd50e-9b28-4ac5-ac77-57d8c596e5b8 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:21:04.334040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c3d541d1-947d-41a3-aee0-a789973ddde0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:04.334677 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c3d541d1-947d-41a3-aee0-a789973ddde0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:04.340788 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3d541d1-947d-41a3-aee0-a789973ddde0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:04.341451 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3d541d1-947d-41a3-aee0-a789973ddde0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:04.341913 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3d541d1-947d-41a3-aee0-a789973ddde0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:04.342625 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3d541d1-947d-41a3-aee0-a789973ddde0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:04.343082 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3d541d1-947d-41a3-aee0-a789973ddde0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:04.343516 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3d541d1-947d-41a3-aee0-a789973ddde0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:04.515061 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c3d541d1-947d-41a3-aee0-a789973ddde0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:04.525766 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c3d541d1-947d-41a3-aee0-a789973ddde0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:04.527357 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c3d541d1-947d-41a3-aee0-a789973ddde0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:04.528825 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c3d541d1-947d-41a3-aee0-a789973ddde0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1738 microversion: 2.20 time: 0.198803 Aug 10 17:21:04.529373 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 455/897] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:04 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:05.209496 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-8ac1bb02-7527-48a9-8c0c-7d7809d65d9a req-9f2257f7-3de9-4095-a8e0-bebb5ce42a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7eaaa8-2f20-4c87-a62a-e855728effb1", "name": "network-vif-plugged", "status": "completed", "tag": "d08afacf-c192-4763-9246-60f0a09579d4"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:21:05.231102 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-8ac1bb02-7527-48a9-8c0c-7d7809d65d9a req-9f2257f7-3de9-4095-a8e0-bebb5ce42a4a service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:05.234934 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-8ac1bb02-7527-48a9-8c0c-7d7809d65d9a req-9f2257f7-3de9-4095-a8e0-bebb5ce42a4a service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:05.234934 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-8ac1bb02-7527-48a9-8c0c-7d7809d65d9a req-9f2257f7-3de9-4095-a8e0-bebb5ce42a4a service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:05.248324 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-8ac1bb02-7527-48a9-8c0c-7d7809d65d9a req-9f2257f7-3de9-4095-a8e0-bebb5ce42a4a service nova] Creating event network-vif-plugged:d08afacf-c192-4763-9246-60f0a09579d4 for instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 on hv-cinder-85272 Aug 10 17:21:05.256630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-8ac1bb02-7527-48a9-8c0c-7d7809d65d9a req-9f2257f7-3de9-4095-a8e0-bebb5ce42a4a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052157 Aug 10 17:21:05.258409 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 443/898] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:05.557946 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7570d5bf-0072-47d2-9154-49340315b78e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:05.558587 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7570d5bf-0072-47d2-9154-49340315b78e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:05.565836 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7570d5bf-0072-47d2-9154-49340315b78e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:05.566417 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7570d5bf-0072-47d2-9154-49340315b78e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:05.567003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7570d5bf-0072-47d2-9154-49340315b78e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:05.567913 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7570d5bf-0072-47d2-9154-49340315b78e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:05.568532 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7570d5bf-0072-47d2-9154-49340315b78e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:05.569187 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7570d5bf-0072-47d2-9154-49340315b78e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:05.724614 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7570d5bf-0072-47d2-9154-49340315b78e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:05.735218 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7570d5bf-0072-47d2-9154-49340315b78e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:05.738122 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7570d5bf-0072-47d2-9154-49340315b78e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:05.739425 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7570d5bf-0072-47d2-9154-49340315b78e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1738 microversion: 2.20 time: 0.186190 Aug 10 17:21:05.754679 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 456/899] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:05 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:06.345134 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0504fc59-d97d-4c9a-8863-45fa3ef37f22 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:06.346484 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0504fc59-d97d-4c9a-8863-45fa3ef37f22 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:06.353250 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0504fc59-d97d-4c9a-8863-45fa3ef37f22 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:06.353934 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0504fc59-d97d-4c9a-8863-45fa3ef37f22 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:06.354720 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0504fc59-d97d-4c9a-8863-45fa3ef37f22 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:06.355602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0504fc59-d97d-4c9a-8863-45fa3ef37f22 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:06.356223 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0504fc59-d97d-4c9a-8863-45fa3ef37f22 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:06.356920 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0504fc59-d97d-4c9a-8863-45fa3ef37f22 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:06.392885 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0504fc59-d97d-4c9a-8863-45fa3ef37f22 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments/0ae1aae3-df3b-49d7-843f-00e829a2410f" status: 200 len: 194 microversion: 2.1 time: 0.053108 Aug 10 17:21:06.393959 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 444/900] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Aug 10 17:21:06 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments/0ae1aae3-df3b-49d7-843f-00e829a2410f => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:06.405084 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-27e5a7af-6f43-4281-aab0-0e5e4006d162 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:06.405589 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-27e5a7af-6f43-4281-aab0-0e5e4006d162 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:06.411981 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27e5a7af-6f43-4281-aab0-0e5e4006d162 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:06.412475 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27e5a7af-6f43-4281-aab0-0e5e4006d162 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:06.412914 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27e5a7af-6f43-4281-aab0-0e5e4006d162 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:06.413652 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27e5a7af-6f43-4281-aab0-0e5e4006d162 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:06.414251 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27e5a7af-6f43-4281-aab0-0e5e4006d162 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:06.414715 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27e5a7af-6f43-4281-aab0-0e5e4006d162 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:06.514963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-27e5a7af-6f43-4281-aab0-0e5e4006d162 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lazy-loading 'services' on Instance uuid 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:21:06.682032 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:21:06.764365 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ab8b2a5f-77c8-49d0-a6f2-d9b621eb110c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:06.765607 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ab8b2a5f-77c8-49d0-a6f2-d9b621eb110c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:06.773659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab8b2a5f-77c8-49d0-a6f2-d9b621eb110c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:06.774280 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab8b2a5f-77c8-49d0-a6f2-d9b621eb110c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:06.775549 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab8b2a5f-77c8-49d0-a6f2-d9b621eb110c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:06.776356 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab8b2a5f-77c8-49d0-a6f2-d9b621eb110c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:06.776896 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab8b2a5f-77c8-49d0-a6f2-d9b621eb110c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:06.777400 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ab8b2a5f-77c8-49d0-a6f2-d9b621eb110c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:06.790959 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-27e5a7af-6f43-4281-aab0-0e5e4006d162 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments/0ae1aae3-df3b-49d7-843f-00e829a2410f" status: 202 len: 0 microversion: 2.1 time: 0.381183 Aug 10 17:21:06.790959 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 457/901] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 17:21:06 2022] DELETE /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments/0ae1aae3-df3b-49d7-843f-00e829a2410f => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:21:06.941409 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ab8b2a5f-77c8-49d0-a6f2-d9b621eb110c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:06.950838 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ab8b2a5f-77c8-49d0-a6f2-d9b621eb110c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:06.952435 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ab8b2a5f-77c8-49d0-a6f2-d9b621eb110c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:06.953862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ab8b2a5f-77c8-49d0-a6f2-d9b621eb110c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1738 microversion: 2.20 time: 0.193363 Aug 10 17:21:06.954671 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 445/902] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:06 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:21:07.980624 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3c5f7fbf-de2b-45fc-a870-ac0b6f1c17ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:07.981740 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3c5f7fbf-de2b-45fc-a870-ac0b6f1c17ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:07.989885 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c5f7fbf-de2b-45fc-a870-ac0b6f1c17ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:07.990649 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c5f7fbf-de2b-45fc-a870-ac0b6f1c17ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:07.991245 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c5f7fbf-de2b-45fc-a870-ac0b6f1c17ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:07.994657 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c5f7fbf-de2b-45fc-a870-ac0b6f1c17ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:07.994657 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c5f7fbf-de2b-45fc-a870-ac0b6f1c17ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:07.994657 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c5f7fbf-de2b-45fc-a870-ac0b6f1c17ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:08.171376 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3c5f7fbf-de2b-45fc-a870-ac0b6f1c17ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:08.182614 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3c5f7fbf-de2b-45fc-a870-ac0b6f1c17ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:08.184582 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3c5f7fbf-de2b-45fc-a870-ac0b6f1c17ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:08.185881 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3c5f7fbf-de2b-45fc-a870-ac0b6f1c17ea tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1738 microversion: 2.20 time: 0.211795 Aug 10 17:21:08.186538 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 458/903] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:07 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:09.104061 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-967df0be-cb79-4a45-9d9b-102d9c6d996d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:09.106318 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-967df0be-cb79-4a45-9d9b-102d9c6d996d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:09.113888 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-967df0be-cb79-4a45-9d9b-102d9c6d996d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:09.114393 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-967df0be-cb79-4a45-9d9b-102d9c6d996d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:09.115100 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-967df0be-cb79-4a45-9d9b-102d9c6d996d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:09.117653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-967df0be-cb79-4a45-9d9b-102d9c6d996d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:09.120738 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-967df0be-cb79-4a45-9d9b-102d9c6d996d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:09.121940 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-967df0be-cb79-4a45-9d9b-102d9c6d996d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:09.168707 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-967df0be-cb79-4a45-9d9b-102d9c6d996d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070559 Aug 10 17:21:09.169875 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 446/904] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:21:09 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:21:09.209428 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d1f355be-2a03-4cbf-afa3-cbd1a1b4337f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:09.210701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d1f355be-2a03-4cbf-afa3-cbd1a1b4337f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:09.218248 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f355be-2a03-4cbf-afa3-cbd1a1b4337f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:09.219230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f355be-2a03-4cbf-afa3-cbd1a1b4337f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:09.219899 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f355be-2a03-4cbf-afa3-cbd1a1b4337f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:09.221396 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f355be-2a03-4cbf-afa3-cbd1a1b4337f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:09.222070 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f355be-2a03-4cbf-afa3-cbd1a1b4337f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:09.222932 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f355be-2a03-4cbf-afa3-cbd1a1b4337f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:09.317933 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-73f043d2-24c5-427d-b29c-c106267709bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:09.320200 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-73f043d2-24c5-427d-b29c-c106267709bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:09.329673 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73f043d2-24c5-427d-b29c-c106267709bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:09.330630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73f043d2-24c5-427d-b29c-c106267709bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:09.331455 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73f043d2-24c5-427d-b29c-c106267709bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:09.332626 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73f043d2-24c5-427d-b29c-c106267709bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:09.333157 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73f043d2-24c5-427d-b29c-c106267709bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:09.333658 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73f043d2-24c5-427d-b29c-c106267709bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:09.390765 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-73f043d2-24c5-427d-b29c-c106267709bc tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077426 Aug 10 17:21:09.397091 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d1f355be-2a03-4cbf-afa3-cbd1a1b4337f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:09.410887 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 447/905] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:21:09 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 17:21:09.418977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d1f355be-2a03-4cbf-afa3-cbd1a1b4337f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:09.420758 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d1f355be-2a03-4cbf-afa3-cbd1a1b4337f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:09.426951 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d1f355be-2a03-4cbf-afa3-cbd1a1b4337f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1738 microversion: 2.20 time: 0.217018 Aug 10 17:21:09.426951 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 459/906] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:09 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:09.482556 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-56ff0d66-cd83-4f9e-82cb-cbddff87dbc2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:09.483352 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-56ff0d66-cd83-4f9e-82cb-cbddff87dbc2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:09.490493 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56ff0d66-cd83-4f9e-82cb-cbddff87dbc2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:09.490993 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56ff0d66-cd83-4f9e-82cb-cbddff87dbc2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:09.491432 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56ff0d66-cd83-4f9e-82cb-cbddff87dbc2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:09.492333 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56ff0d66-cd83-4f9e-82cb-cbddff87dbc2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:09.492790 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56ff0d66-cd83-4f9e-82cb-cbddff87dbc2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:09.493210 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56ff0d66-cd83-4f9e-82cb-cbddff87dbc2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:09.527185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-56ff0d66-cd83-4f9e-82cb-cbddff87dbc2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:21:09.789363 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-56ff0d66-cd83-4f9e-82cb-cbddff87dbc2 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 204 len: 0 microversion: 2.1 time: 0.310363 Aug 10 17:21:09.789883 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 448/907] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:21:09 2022] DELETE /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:21:09.798443 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0d79316a-2506-4316-9240-ed124b8e76f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:09.799240 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0d79316a-2506-4316-9240-ed124b8e76f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:09.806205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d79316a-2506-4316-9240-ed124b8e76f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:09.806809 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d79316a-2506-4316-9240-ed124b8e76f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:09.807324 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d79316a-2506-4316-9240-ed124b8e76f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:09.808107 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d79316a-2506-4316-9240-ed124b8e76f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:09.808656 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d79316a-2506-4316-9240-ed124b8e76f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:09.809269 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d79316a-2506-4316-9240-ed124b8e76f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:09.966218 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0d79316a-2506-4316-9240-ed124b8e76f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:09.975634 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0d79316a-2506-4316-9240-ed124b8e76f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1672 microversion: 2.1 time: 0.180961 Aug 10 17:21:09.976419 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 460/908] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:09 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:10.450154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1170f696-c151-4d25-9b1d-a25860e7cb98 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:10.451015 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1170f696-c151-4d25-9b1d-a25860e7cb98 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:10.457595 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1170f696-c151-4d25-9b1d-a25860e7cb98 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:10.458085 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1170f696-c151-4d25-9b1d-a25860e7cb98 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:10.458564 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1170f696-c151-4d25-9b1d-a25860e7cb98 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:10.459256 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1170f696-c151-4d25-9b1d-a25860e7cb98 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:10.459738 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1170f696-c151-4d25-9b1d-a25860e7cb98 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:10.460239 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1170f696-c151-4d25-9b1d-a25860e7cb98 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:10.600033 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1170f696-c151-4d25-9b1d-a25860e7cb98 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:10.608522 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1170f696-c151-4d25-9b1d-a25860e7cb98 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:10.610046 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1170f696-c151-4d25-9b1d-a25860e7cb98 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:10.611275 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1170f696-c151-4d25-9b1d-a25860e7cb98 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1738 microversion: 2.20 time: 0.166503 Aug 10 17:21:10.611784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 449/909] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:10 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:10.996963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cefcabe1-6204-44b0-b186-dd934cc071f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:10.997592 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cefcabe1-6204-44b0-b186-dd934cc071f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:11.004382 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cefcabe1-6204-44b0-b186-dd934cc071f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:11.004867 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cefcabe1-6204-44b0-b186-dd934cc071f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:11.005309 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cefcabe1-6204-44b0-b186-dd934cc071f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:11.006000 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cefcabe1-6204-44b0-b186-dd934cc071f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:11.006502 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cefcabe1-6204-44b0-b186-dd934cc071f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:11.006931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cefcabe1-6204-44b0-b186-dd934cc071f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:11.143549 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cefcabe1-6204-44b0-b186-dd934cc071f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:11.152190 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cefcabe1-6204-44b0-b186-dd934cc071f3 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1672 microversion: 2.1 time: 0.159090 Aug 10 17:21:11.161004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 461/910] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:10 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:11.639513 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a68796ac-1e99-4714-9119-f2d63e148dfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:11.640158 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a68796ac-1e99-4714-9119-f2d63e148dfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:11.647184 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a68796ac-1e99-4714-9119-f2d63e148dfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:11.648184 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a68796ac-1e99-4714-9119-f2d63e148dfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:11.648820 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a68796ac-1e99-4714-9119-f2d63e148dfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:11.649529 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a68796ac-1e99-4714-9119-f2d63e148dfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:11.649990 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a68796ac-1e99-4714-9119-f2d63e148dfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:11.650474 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a68796ac-1e99-4714-9119-f2d63e148dfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:11.803124 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a68796ac-1e99-4714-9119-f2d63e148dfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:11.811594 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a68796ac-1e99-4714-9119-f2d63e148dfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:11.813537 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a68796ac-1e99-4714-9119-f2d63e148dfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:11.814752 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a68796ac-1e99-4714-9119-f2d63e148dfd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1738 microversion: 2.20 time: 0.180965 Aug 10 17:21:11.817495 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 450/911] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:11 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:12.173921 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-21eb9ce8-b557-4b59-82df-ab060246055d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:12.176363 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-21eb9ce8-b557-4b59-82df-ab060246055d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:12.184217 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21eb9ce8-b557-4b59-82df-ab060246055d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:12.184992 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21eb9ce8-b557-4b59-82df-ab060246055d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:12.185856 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21eb9ce8-b557-4b59-82df-ab060246055d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:12.186863 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21eb9ce8-b557-4b59-82df-ab060246055d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:12.187578 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21eb9ce8-b557-4b59-82df-ab060246055d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:12.188262 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21eb9ce8-b557-4b59-82df-ab060246055d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:12.343566 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-21eb9ce8-b557-4b59-82df-ab060246055d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:12.353218 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-21eb9ce8-b557-4b59-82df-ab060246055d tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1672 microversion: 2.1 time: 0.183585 Aug 10 17:21:12.353995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 462/912] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:12 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1672 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:12.839087 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ae3dbbf6-f103-4f51-b91d-5f52e17fdb8b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:12.842053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ae3dbbf6-f103-4f51-b91d-5f52e17fdb8b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:12.850268 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ae3dbbf6-f103-4f51-b91d-5f52e17fdb8b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:12.851188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ae3dbbf6-f103-4f51-b91d-5f52e17fdb8b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:12.852768 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ae3dbbf6-f103-4f51-b91d-5f52e17fdb8b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:12.853753 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ae3dbbf6-f103-4f51-b91d-5f52e17fdb8b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:12.854470 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ae3dbbf6-f103-4f51-b91d-5f52e17fdb8b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:12.855121 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ae3dbbf6-f103-4f51-b91d-5f52e17fdb8b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:13.089655 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ae3dbbf6-f103-4f51-b91d-5f52e17fdb8b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:13.099053 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-2630026c-1ac6-4a5e-9a7f-512b7f301296 req-584cc96a-36e0-4b12-942a-23778c062708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f39ecbc-070d-4ad9-9ac3-3bb23fe51438", "name": "network-vif-deleted", "tag": "380440cb-8fb3-4cef-9587-9e46611a7ec1"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:21:13.110073 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ae3dbbf6-f103-4f51-b91d-5f52e17fdb8b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:13.111175 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2630026c-1ac6-4a5e-9a7f-512b7f301296 req-584cc96a-36e0-4b12-942a-23778c062708 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:13.111700 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2630026c-1ac6-4a5e-9a7f-512b7f301296 req-584cc96a-36e0-4b12-942a-23778c062708 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:13.112837 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2630026c-1ac6-4a5e-9a7f-512b7f301296 req-584cc96a-36e0-4b12-942a-23778c062708 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:13.114712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ae3dbbf6-f103-4f51-b91d-5f52e17fdb8b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:13.116666 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ae3dbbf6-f103-4f51-b91d-5f52e17fdb8b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1738 microversion: 2.20 time: 0.281577 Aug 10 17:21:13.129916 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 451/913] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:12 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:13.147772 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-2630026c-1ac6-4a5e-9a7f-512b7f301296 req-584cc96a-36e0-4b12-942a-23778c062708 service nova] Creating event network-vif-deleted:380440cb-8fb3-4cef-9587-9e46611a7ec1 for instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 on hv-cinder-85272 Aug 10 17:21:13.153241 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-2630026c-1ac6-4a5e-9a7f-512b7f301296 req-584cc96a-36e0-4b12-942a-23778c062708 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059015 Aug 10 17:21:13.154091 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 463/914] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:13.376024 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-75606bfd-31aa-468b-85a7-ceeef359157a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:13.376682 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-75606bfd-31aa-468b-85a7-ceeef359157a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:13.385429 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-75606bfd-31aa-468b-85a7-ceeef359157a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:13.386061 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-75606bfd-31aa-468b-85a7-ceeef359157a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:13.393271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-75606bfd-31aa-468b-85a7-ceeef359157a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:13.393271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-75606bfd-31aa-468b-85a7-ceeef359157a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:13.393271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-75606bfd-31aa-468b-85a7-ceeef359157a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:13.393271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-75606bfd-31aa-468b-85a7-ceeef359157a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:13.469179 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-75606bfd-31aa-468b-85a7-ceeef359157a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:13.480018 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-75606bfd-31aa-468b-85a7-ceeef359157a tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1604 microversion: 2.1 time: 0.109259 Aug 10 17:21:13.481183 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 452/915] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:13 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1604 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:14.145256 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-60d17094-e204-4f13-9448-8e0c6a236b70 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:14.146001 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-60d17094-e204-4f13-9448-8e0c6a236b70 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:14.152117 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60d17094-e204-4f13-9448-8e0c6a236b70 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:14.152608 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60d17094-e204-4f13-9448-8e0c6a236b70 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:14.153049 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60d17094-e204-4f13-9448-8e0c6a236b70 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:14.153743 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60d17094-e204-4f13-9448-8e0c6a236b70 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:14.154200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60d17094-e204-4f13-9448-8e0c6a236b70 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:14.154651 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60d17094-e204-4f13-9448-8e0c6a236b70 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:14.290082 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-60d17094-e204-4f13-9448-8e0c6a236b70 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:14.298147 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-60d17094-e204-4f13-9448-8e0c6a236b70 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:14.299734 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-60d17094-e204-4f13-9448-8e0c6a236b70 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:14.304975 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-60d17094-e204-4f13-9448-8e0c6a236b70 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1738 microversion: 2.20 time: 0.161272 Aug 10 17:21:14.304975 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 464/916] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:14 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:14.502371 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1aeda7dc-1f17-4775-a874-4fdc96665fe8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:14.503717 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1aeda7dc-1f17-4775-a874-4fdc96665fe8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:14.513358 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aeda7dc-1f17-4775-a874-4fdc96665fe8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:14.513849 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aeda7dc-1f17-4775-a874-4fdc96665fe8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:14.517495 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aeda7dc-1f17-4775-a874-4fdc96665fe8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:14.517495 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aeda7dc-1f17-4775-a874-4fdc96665fe8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:14.517495 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aeda7dc-1f17-4775-a874-4fdc96665fe8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:14.517495 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aeda7dc-1f17-4775-a874-4fdc96665fe8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:14.582983 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aeda7dc-1f17-4775-a874-4fdc96665fe8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:14.583475 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aeda7dc-1f17-4775-a874-4fdc96665fe8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:14.584178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1aeda7dc-1f17-4775-a874-4fdc96665fe8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:14.584636 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-1aeda7dc-1f17-4775-a874-4fdc96665fe8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lazy-loading 'fault' on Instance uuid 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:21:14.600121 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:21:14.654854 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1aeda7dc-1f17-4775-a874-4fdc96665fe8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f74a20789dc4ef697861146252bacba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e92e1e1c27241798e336e547580be5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:14.665450 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1aeda7dc-1f17-4775-a874-4fdc96665fe8 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 200 len: 1327 microversion: 2.1 time: 0.165830 Aug 10 17:21:14.667267 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 453/917] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:14 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 1327 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:15.230918 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5b038cb4-229c-4fea-9f7c-55866a3f87dd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:15.240937 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5b038cb4-229c-4fea-9f7c-55866a3f87dd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:15.240937 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b038cb4-229c-4fea-9f7c-55866a3f87dd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:15.240937 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b038cb4-229c-4fea-9f7c-55866a3f87dd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:15.240937 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b038cb4-229c-4fea-9f7c-55866a3f87dd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:15.241386 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b038cb4-229c-4fea-9f7c-55866a3f87dd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:15.241386 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b038cb4-229c-4fea-9f7c-55866a3f87dd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:15.241386 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b038cb4-229c-4fea-9f7c-55866a3f87dd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:15.263997 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5b038cb4-229c-4fea-9f7c-55866a3f87dd tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/ips" status: 200 len: 148 microversion: 2.1 time: 0.036904 Aug 10 17:21:15.264561 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 465/918] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 17:21:15 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:15.324037 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b458a715-2836-4138-92f9-2aad5c3105c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:15.325255 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b458a715-2836-4138-92f9-2aad5c3105c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:15.331748 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b458a715-2836-4138-92f9-2aad5c3105c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:15.332234 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b458a715-2836-4138-92f9-2aad5c3105c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:15.332669 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b458a715-2836-4138-92f9-2aad5c3105c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:15.333366 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b458a715-2836-4138-92f9-2aad5c3105c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:15.333822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b458a715-2836-4138-92f9-2aad5c3105c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:15.334248 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b458a715-2836-4138-92f9-2aad5c3105c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:15.480389 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b458a715-2836-4138-92f9-2aad5c3105c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:15.489314 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b458a715-2836-4138-92f9-2aad5c3105c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:15.491440 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b458a715-2836-4138-92f9-2aad5c3105c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:15.492646 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b458a715-2836-4138-92f9-2aad5c3105c1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1738 microversion: 2.20 time: 0.172833 Aug 10 17:21:15.493194 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 454/919] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:15 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:15.691916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4583e84f-899f-406d-8a9a-58647b0abcca tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:15.692531 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4583e84f-899f-406d-8a9a-58647b0abcca tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:15.698504 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4583e84f-899f-406d-8a9a-58647b0abcca tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:15.698991 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4583e84f-899f-406d-8a9a-58647b0abcca tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:15.699520 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4583e84f-899f-406d-8a9a-58647b0abcca tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:15.700110 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4583e84f-899f-406d-8a9a-58647b0abcca tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:15.700596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4583e84f-899f-406d-8a9a-58647b0abcca tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:15.701023 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4583e84f-899f-406d-8a9a-58647b0abcca tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:15.714966 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-4583e84f-899f-406d-8a9a-58647b0abcca tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] HTTP exception thrown: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4583e84f-899f-406d-8a9a-58647b0abcca tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Request method failure captured: Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 HTTP/1.1 Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-d5YvUJTscl0tmUlh0361qrv7AI7UnRd2i-kX9PquIkHs68jqx7talr9gFD_UFTDIZDD2RgD0B8ezbRDzIMHv4GfdPb2AQRCo8PqywIIH0qwLEzBHNns8gpByV43VV9sNlR1W9ja0ChhNvdv1_8TyBAUmPbETY-Z8dDU1Th0YV80iA Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: 7e92e1e1c27241798e336e547580be5e Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:21:15.716612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:21:15.718275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7e92e1e1c27241798e336e547580be5e", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7e92e1e1c27241798e336e547580be5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7e92e1e1c27241798e336e547580be5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7e92e1e1c27241798e336e547580be5e"}]}] Aug 10 17:21:15.718275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:15.718275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 7e92e1e1c27241798e336e547580be5e Aug 10 17:21:15.718275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:15.718275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeTestJSON-2137161467-project Aug 10 17:21:15.718275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:21:15.718275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:21:15.718275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 2f74a20789dc4ef697861146252bacba Aug 10 17:21:15.718275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeTestJSON-2137161467-project Aug 10 17:21:15.718275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:21:15.718275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:15.718275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': '4f39ecbc-070d-4ad9-9ac3-3bb23fe51438'} Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:15.719220 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:15.720744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:15.722111 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4583e84f-899f-406d-8a9a-58647b0abcca tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Returning 404 to user: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:15.722111 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4583e84f-899f-406d-8a9a-58647b0abcca tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 404 len: 111 microversion: 2.1 time: 0.030720 Aug 10 17:21:15.722111 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 466/920] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:15 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:21:15.727089 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-dad6d251-d5d1-4bbc-9bc2-a9b2a062e967 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '.version_select at 0x7f7eb9fcbee0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:15.807373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-dad6d251-d5d1-4bbc-9bc2-a9b2a062e967 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-518112755" status: 202 len: 0 microversion: 2.1 time: 0.084063 Aug 10 17:21:15.807959 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 455/921] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 10 17:21:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-518112755 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:21:16.515674 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d228fd1c-f3b8-4ff6-ac2e-f1766094717b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:16.516293 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d228fd1c-f3b8-4ff6-ac2e-f1766094717b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:16.523802 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d228fd1c-f3b8-4ff6-ac2e-f1766094717b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:16.524711 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d228fd1c-f3b8-4ff6-ac2e-f1766094717b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:16.525168 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d228fd1c-f3b8-4ff6-ac2e-f1766094717b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:16.525879 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d228fd1c-f3b8-4ff6-ac2e-f1766094717b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:16.526335 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d228fd1c-f3b8-4ff6-ac2e-f1766094717b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:16.526787 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d228fd1c-f3b8-4ff6-ac2e-f1766094717b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:16.738224 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d228fd1c-f3b8-4ff6-ac2e-f1766094717b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:16.747605 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d228fd1c-f3b8-4ff6-ac2e-f1766094717b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:16.749114 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d228fd1c-f3b8-4ff6-ac2e-f1766094717b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:16.750516 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d228fd1c-f3b8-4ff6-ac2e-f1766094717b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1720 microversion: 2.20 time: 0.238876 Aug 10 17:21:16.752727 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 467/922] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:16 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:16.974199 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bd3bec2f-890b-40ee-92b2-b58938388e8a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e724587b-69a1-4142-8962-fc92d97bfdd5"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:21:16.976684 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-bd3bec2f-890b-40ee-92b2-b58938388e8a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:16.984441 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd3bec2f-890b-40ee-92b2-b58938388e8a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:16.984668 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd3bec2f-890b-40ee-92b2-b58938388e8a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:16.985112 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd3bec2f-890b-40ee-92b2-b58938388e8a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:16.985813 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd3bec2f-890b-40ee-92b2-b58938388e8a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:16.986275 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd3bec2f-890b-40ee-92b2-b58938388e8a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:16.986735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd3bec2f-890b-40ee-92b2-b58938388e8a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:17.774125 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4c853bd1-04fc-442f-8d1e-5f057a311d03 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:17.775200 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4c853bd1-04fc-442f-8d1e-5f057a311d03 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:17.781701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c853bd1-04fc-442f-8d1e-5f057a311d03 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:17.782189 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c853bd1-04fc-442f-8d1e-5f057a311d03 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:17.782667 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c853bd1-04fc-442f-8d1e-5f057a311d03 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:17.783365 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c853bd1-04fc-442f-8d1e-5f057a311d03 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:17.783826 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c853bd1-04fc-442f-8d1e-5f057a311d03 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:17.784280 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c853bd1-04fc-442f-8d1e-5f057a311d03 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:17.917226 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4c853bd1-04fc-442f-8d1e-5f057a311d03 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:17.926035 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4c853bd1-04fc-442f-8d1e-5f057a311d03 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:17.927577 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4c853bd1-04fc-442f-8d1e-5f057a311d03 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:17.928741 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4c853bd1-04fc-442f-8d1e-5f057a311d03 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1720 microversion: 2.20 time: 0.158857 Aug 10 17:21:17.929295 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 468/923] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:17 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:18.951626 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-27c6ee34-087b-475d-9323-c7eb11278173 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:18.952324 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-27c6ee34-087b-475d-9323-c7eb11278173 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:18.959481 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27c6ee34-087b-475d-9323-c7eb11278173 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:18.959967 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27c6ee34-087b-475d-9323-c7eb11278173 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:18.960399 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27c6ee34-087b-475d-9323-c7eb11278173 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:18.961137 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27c6ee34-087b-475d-9323-c7eb11278173 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:18.961585 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27c6ee34-087b-475d-9323-c7eb11278173 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:18.962064 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27c6ee34-087b-475d-9323-c7eb11278173 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:19.095227 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-27c6ee34-087b-475d-9323-c7eb11278173 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:19.103304 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-27c6ee34-087b-475d-9323-c7eb11278173 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:19.104791 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-27c6ee34-087b-475d-9323-c7eb11278173 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:19.105941 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-27c6ee34-087b-475d-9323-c7eb11278173 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1720 microversion: 2.20 time: 0.158337 Aug 10 17:21:19.106704 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 469/924] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:18 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:21:19.361155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bd3bec2f-890b-40ee-92b2-b58938388e8a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "POST /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.389123 Aug 10 17:21:19.361155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 456/925] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 17:21:16 2022] POST /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments => generated 194 bytes in 2391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:21:19.715493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-847f92e0-9706-4570-9ff7-2e20fd38dabe tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:19.715997 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-847f92e0-9706-4570-9ff7-2e20fd38dabe tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:19.722728 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-847f92e0-9706-4570-9ff7-2e20fd38dabe tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:19.723233 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-847f92e0-9706-4570-9ff7-2e20fd38dabe tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:19.723692 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-847f92e0-9706-4570-9ff7-2e20fd38dabe tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:19.724382 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-847f92e0-9706-4570-9ff7-2e20fd38dabe tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:19.724830 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-847f92e0-9706-4570-9ff7-2e20fd38dabe tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:19.725252 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-847f92e0-9706-4570-9ff7-2e20fd38dabe tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:19.739247 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-847f92e0-9706-4570-9ff7-2e20fd38dabe tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] HTTP exception thrown: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-847f92e0-9706-4570-9ff7-2e20fd38dabe tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Request method failure captured: Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 HTTP/1.1 Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-d5YvUJTscl0tmUlh0361qrv7AI7UnRd2i-kX9PquIkHs68jqx7talr9gFD_UFTDIZDD2RgD0B8ezbRDzIMHv4GfdPb2AQRCo8PqywIIH0qwLEzBHNns8gpByV43VV9sNlR1W9ja0ChhNvdv1_8TyBAUmPbETY-Z8dDU1Th0YV80iA Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: 7e92e1e1c27241798e336e547580be5e Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:21:19.741027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:21:19.742591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7e92e1e1c27241798e336e547580be5e", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7e92e1e1c27241798e336e547580be5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7e92e1e1c27241798e336e547580be5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7e92e1e1c27241798e336e547580be5e"}]}] Aug 10 17:21:19.742591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:19.742591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 7e92e1e1c27241798e336e547580be5e Aug 10 17:21:19.742591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:19.742591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeTestJSON-2137161467-project Aug 10 17:21:19.742591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:21:19.742591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:21:19.742591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 2f74a20789dc4ef697861146252bacba Aug 10 17:21:19.742591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeTestJSON-2137161467-project Aug 10 17:21:19.742591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:21:19.742591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:19.742591 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': '4f39ecbc-070d-4ad9-9ac3-3bb23fe51438'} Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:19.743413 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:19.744850 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:19.746290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-847f92e0-9706-4570-9ff7-2e20fd38dabe tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Returning 404 to user: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:19.746290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-847f92e0-9706-4570-9ff7-2e20fd38dabe tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 404 len: 111 microversion: 2.1 time: 0.031038 Aug 10 17:21:19.746290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 470/926] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:21:19 2022] DELETE /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:21:19.752180 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-686cb382-3cac-48ef-ba4e-adf792567843 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:19.753254 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-686cb382-3cac-48ef-ba4e-adf792567843 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:19.760017 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-686cb382-3cac-48ef-ba4e-adf792567843 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:19.760503 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-686cb382-3cac-48ef-ba4e-adf792567843 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:19.760944 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-686cb382-3cac-48ef-ba4e-adf792567843 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:19.761633 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-686cb382-3cac-48ef-ba4e-adf792567843 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:19.762089 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-686cb382-3cac-48ef-ba4e-adf792567843 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:19.762704 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-686cb382-3cac-48ef-ba4e-adf792567843 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:19.776875 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-686cb382-3cac-48ef-ba4e-adf792567843 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] HTTP exception thrown: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-686cb382-3cac-48ef-ba4e-adf792567843 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Request method failure captured: Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 HTTP/1.1 Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-d5YvUJTscl0tmUlh0361qrv7AI7UnRd2i-kX9PquIkHs68jqx7talr9gFD_UFTDIZDD2RgD0B8ezbRDzIMHv4GfdPb2AQRCo8PqywIIH0qwLEzBHNns8gpByV43VV9sNlR1W9ja0ChhNvdv1_8TyBAUmPbETY-Z8dDU1Th0YV80iA Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: 7e92e1e1c27241798e336e547580be5e Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:21:19.778542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:21:19.780149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7e92e1e1c27241798e336e547580be5e", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7e92e1e1c27241798e336e547580be5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7e92e1e1c27241798e336e547580be5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7e92e1e1c27241798e336e547580be5e"}]}] Aug 10 17:21:19.780149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:19.780149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 7e92e1e1c27241798e336e547580be5e Aug 10 17:21:19.780149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:19.780149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeTestJSON-2137161467-project Aug 10 17:21:19.780149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:21:19.780149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:21:19.780149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 2f74a20789dc4ef697861146252bacba Aug 10 17:21:19.780149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeTestJSON-2137161467-project Aug 10 17:21:19.780149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:21:19.780149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:19.780149 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': '4f39ecbc-070d-4ad9-9ac3-3bb23fe51438'} Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:19.781041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. Aug 10 17:21:19.782573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:19.783841 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-686cb382-3cac-48ef-ba4e-adf792567843 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Returning 404 to user: Instance 4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:19.783841 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-686cb382-3cac-48ef-ba4e-adf792567843 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438" status: 404 len: 111 microversion: 2.1 time: 0.032614 Aug 10 17:21:19.783841 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 457/927] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:19 2022] GET /compute/v2.1/servers/4f39ecbc-070d-4ad9-9ac3-3bb23fe51438 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:21:20.129802 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-65f64bb3-14d5-4e78-bb8a-13e08bc783ba tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:20.130429 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-65f64bb3-14d5-4e78-bb8a-13e08bc783ba tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:20.137067 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65f64bb3-14d5-4e78-bb8a-13e08bc783ba tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:20.137548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65f64bb3-14d5-4e78-bb8a-13e08bc783ba tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:20.137978 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65f64bb3-14d5-4e78-bb8a-13e08bc783ba tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:20.138689 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65f64bb3-14d5-4e78-bb8a-13e08bc783ba tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:20.139192 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65f64bb3-14d5-4e78-bb8a-13e08bc783ba tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:20.139616 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65f64bb3-14d5-4e78-bb8a-13e08bc783ba tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:20.277547 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-65f64bb3-14d5-4e78-bb8a-13e08bc783ba tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:20.286202 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-65f64bb3-14d5-4e78-bb8a-13e08bc783ba tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:20.287737 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-65f64bb3-14d5-4e78-bb8a-13e08bc783ba tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:20.288901 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-65f64bb3-14d5-4e78-bb8a-13e08bc783ba tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1663 microversion: 2.20 time: 0.163366 Aug 10 17:21:20.289450 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 471/928] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:20 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:20.311837 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9e8f8609-47af-4e6b-a5c3-d391cabcb12c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4fcd0ec-b222-4d8d-82a3-534328301e17"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:21:20.314225 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9e8f8609-47af-4e6b-a5c3-d391cabcb12c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:20.320392 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e8f8609-47af-4e6b-a5c3-d391cabcb12c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:20.320858 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e8f8609-47af-4e6b-a5c3-d391cabcb12c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:20.321292 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e8f8609-47af-4e6b-a5c3-d391cabcb12c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:20.321981 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e8f8609-47af-4e6b-a5c3-d391cabcb12c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:20.322465 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e8f8609-47af-4e6b-a5c3-d391cabcb12c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:20.322889 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e8f8609-47af-4e6b-a5c3-d391cabcb12c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:21.083645 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-660a620f-ae18-4e1c-8aef-8e62be43eed7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:21.084153 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-660a620f-ae18-4e1c-8aef-8e62be43eed7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:21.090163 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-660a620f-ae18-4e1c-8aef-8e62be43eed7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:21.090692 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-660a620f-ae18-4e1c-8aef-8e62be43eed7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:21.091141 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-660a620f-ae18-4e1c-8aef-8e62be43eed7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:21.091852 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-660a620f-ae18-4e1c-8aef-8e62be43eed7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:21.092312 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-660a620f-ae18-4e1c-8aef-8e62be43eed7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:21.092739 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-660a620f-ae18-4e1c-8aef-8e62be43eed7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:21.107441 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-660a620f-ae18-4e1c-8aef-8e62be43eed7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] HTTP exception thrown: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-660a620f-ae18-4e1c-8aef-8e62be43eed7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Request method failure captured: Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d HTTP/1.1 Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-d5YvUJTscl0tmUlh0361qrv7AI7UnRd2i-kX9PquIkHs68jqx7talr9gFD_UFTDIZDD2RgD0B8ezbRDzIMHv4GfdPb2AQRCo8PqywIIH0qwLEzBHNns8gpByV43VV9sNlR1W9ja0ChhNvdv1_8TyBAUmPbETY-Z8dDU1Th0YV80iA Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: 7e92e1e1c27241798e336e547580be5e Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:21:21.108730 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:21:21.110290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7e92e1e1c27241798e336e547580be5e", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7e92e1e1c27241798e336e547580be5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7e92e1e1c27241798e336e547580be5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7e92e1e1c27241798e336e547580be5e"}]}] Aug 10 17:21:21.110290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:21.110290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 7e92e1e1c27241798e336e547580be5e Aug 10 17:21:21.110290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:21.110290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeTestJSON-2137161467-project Aug 10 17:21:21.110290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:21:21.110290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:21:21.110290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 2f74a20789dc4ef697861146252bacba Aug 10 17:21:21.110290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeTestJSON-2137161467-project Aug 10 17:21:21.110290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:21:21.110290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:21:21.110290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': 'ffd37426-ce25-4561-91df-9058dc474b7d'} Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:21.111301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:21:21.113004 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:21.114693 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-660a620f-ae18-4e1c-8aef-8e62be43eed7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Returning 404 to user: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:21.114693 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-660a620f-ae18-4e1c-8aef-8e62be43eed7 tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 404 len: 111 microversion: 2.1 time: 0.031381 Aug 10 17:21:21.114693 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 472/929] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:21:21 2022] DELETE /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:21:21.119014 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2213bfb4-338d-4c0d-8827-e7b5582e47db tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:21.119630 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2213bfb4-338d-4c0d-8827-e7b5582e47db tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] [instance: ffd37426-ce25-4561-91df-9058dc474b7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:21.125664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2213bfb4-338d-4c0d-8827-e7b5582e47db tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:21.126161 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2213bfb4-338d-4c0d-8827-e7b5582e47db tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:21.130327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2213bfb4-338d-4c0d-8827-e7b5582e47db tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:21.130327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2213bfb4-338d-4c0d-8827-e7b5582e47db tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:21.130327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2213bfb4-338d-4c0d-8827-e7b5582e47db tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:21.130327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2213bfb4-338d-4c0d-8827-e7b5582e47db tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:21.143528 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-2213bfb4-338d-4c0d-8827-e7b5582e47db tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] HTTP exception thrown: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2213bfb4-338d-4c0d-8827-e7b5582e47db tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Request method failure captured: Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d HTTP/1.1 Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-d5YvUJTscl0tmUlh0361qrv7AI7UnRd2i-kX9PquIkHs68jqx7talr9gFD_UFTDIZDD2RgD0B8ezbRDzIMHv4GfdPb2AQRCo8PqywIIH0qwLEzBHNns8gpByV43VV9sNlR1W9ja0ChhNvdv1_8TyBAUmPbETY-Z8dDU1Th0YV80iA Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: 7e92e1e1c27241798e336e547580be5e Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:21:21.145726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:21:21.147251 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7e92e1e1c27241798e336e547580be5e", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7e92e1e1c27241798e336e547580be5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7e92e1e1c27241798e336e547580be5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7e92e1e1c27241798e336e547580be5e"}]}] Aug 10 17:21:21.147251 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:21.147251 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 7e92e1e1c27241798e336e547580be5e Aug 10 17:21:21.147251 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2137161467 Aug 10 17:21:21.147251 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeTestJSON-2137161467-project Aug 10 17:21:21.147251 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:21:21.147251 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:21:21.147251 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 2f74a20789dc4ef697861146252bacba Aug 10 17:21:21.147251 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeTestJSON-2137161467-project Aug 10 17:21:21.147251 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:21:21.147251 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:21:21.147251 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': 'ffd37426-ce25-4561-91df-9058dc474b7d'} Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:21.148065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. Aug 10 17:21:21.149282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:21.150411 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2213bfb4-338d-4c0d-8827-e7b5582e47db tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] Returning 404 to user: Instance ffd37426-ce25-4561-91df-9058dc474b7d could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:21.150411 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2213bfb4-338d-4c0d-8827-e7b5582e47db tempest-AttachVolumeTestJSON-2137161467 tempest-AttachVolumeTestJSON-2137161467-project] 10.222.0.45 "GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d" status: 404 len: 111 microversion: 2.1 time: 0.031988 Aug 10 17:21:21.150411 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 473/930] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:21 2022] GET /compute/v2.1/servers/ffd37426-ce25-4561-91df-9058dc474b7d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:21:21.241201 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-e4520437-9dc7-4051-a87a-11ce802a80b0 req-a68244d8-6f5b-4a03-b0b0-8d15343b94e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7eaaa8-2f20-4c87-a62a-e855728effb1", "name": "network-vif-unplugged", "status": "completed", "tag": "d08afacf-c192-4763-9246-60f0a09579d4"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:21:21.252245 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e4520437-9dc7-4051-a87a-11ce802a80b0 req-a68244d8-6f5b-4a03-b0b0-8d15343b94e1 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:21.252885 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e4520437-9dc7-4051-a87a-11ce802a80b0 req-a68244d8-6f5b-4a03-b0b0-8d15343b94e1 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:21.253412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e4520437-9dc7-4051-a87a-11ce802a80b0 req-a68244d8-6f5b-4a03-b0b0-8d15343b94e1 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:21.265141 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.compute.server_external_events [req-e4520437-9dc7-4051-a87a-11ce802a80b0 req-a68244d8-6f5b-4a03-b0b0-8d15343b94e1 service nova] Unable to find a host for instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1. Dropping event network-vif-unplugged {{(pid=121232) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 17:21:21.266137 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-e4520437-9dc7-4051-a87a-11ce802a80b0 req-a68244d8-6f5b-4a03-b0b0-8d15343b94e1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030561 Aug 10 17:21:21.266930 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 474/931] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 17:21:21.405522 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9e8f8609-47af-4e6b-a5c3-d391cabcb12c tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "POST /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.097563 Aug 10 17:21:21.406486 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 458/932] 10.222.0.45 () {62 vars in 1364 bytes} [Wed Aug 10 17:21:20 2022] POST /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1/os-volume_attachments => generated 188 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:21:21.539251 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9e3bdf07-d430-4585-9677-35a40f3c3fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:21.539754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9e3bdf07-d430-4585-9677-35a40f3c3fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:21.546201 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9e3bdf07-d430-4585-9677-35a40f3c3fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:21.546943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9e3bdf07-d430-4585-9677-35a40f3c3fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:21.553817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9e3bdf07-d430-4585-9677-35a40f3c3fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:21.553817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9e3bdf07-d430-4585-9677-35a40f3c3fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:21.553817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9e3bdf07-d430-4585-9677-35a40f3c3fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:21.553817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9e3bdf07-d430-4585-9677-35a40f3c3fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:22.353863 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9e3bdf07-d430-4585-9677-35a40f3c3fa1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1/os-volume_attachments/c4fcd0ec-b222-4d8d-82a3-534328301e17" status: 202 len: 0 microversion: 2.20 time: 0.819205 Aug 10 17:21:22.355235 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 475/933] 10.222.0.45 () {60 vars in 1457 bytes} [Wed Aug 10 17:21:21 2022] DELETE /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1/os-volume_attachments/c4fcd0ec-b222-4d8d-82a3-534328301e17 => generated 0 bytes in 821 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:21:22.416462 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-97e8469a-18f9-48e7-af5f-c1a592c6caa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:21:22.417058 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-97e8469a-18f9-48e7-af5f-c1a592c6caa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:22.424286 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-97e8469a-18f9-48e7-af5f-c1a592c6caa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:22.425381 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-97e8469a-18f9-48e7-af5f-c1a592c6caa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:22.425381 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-97e8469a-18f9-48e7-af5f-c1a592c6caa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:22.425989 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-97e8469a-18f9-48e7-af5f-c1a592c6caa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:22.427241 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-97e8469a-18f9-48e7-af5f-c1a592c6caa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:22.428426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-97e8469a-18f9-48e7-af5f-c1a592c6caa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:22.460957 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-97e8469a-18f9-48e7-af5f-c1a592c6caa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121231) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 17:21:22.779596 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-97e8469a-18f9-48e7-af5f-c1a592c6caa6 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "POST /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1/action" status: 202 len: 0 microversion: 2.20 time: 0.367032 Aug 10 17:21:22.780358 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 459/934] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 10 17:21:22 2022] POST /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:21:22.789473 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d7cfb653-bd61-4167-aad8-72fe18a85295 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:22.790088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d7cfb653-bd61-4167-aad8-72fe18a85295 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:22.802090 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7cfb653-bd61-4167-aad8-72fe18a85295 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:22.802686 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7cfb653-bd61-4167-aad8-72fe18a85295 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:22.803129 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7cfb653-bd61-4167-aad8-72fe18a85295 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:22.803837 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7cfb653-bd61-4167-aad8-72fe18a85295 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:22.804294 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7cfb653-bd61-4167-aad8-72fe18a85295 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:22.804721 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d7cfb653-bd61-4167-aad8-72fe18a85295 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:22.809703 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:21:23.025273 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d7cfb653-bd61-4167-aad8-72fe18a85295 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:23.034870 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d7cfb653-bd61-4167-aad8-72fe18a85295 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:23.036532 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d7cfb653-bd61-4167-aad8-72fe18a85295 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:23.038137 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d7cfb653-bd61-4167-aad8-72fe18a85295 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1671 microversion: 2.20 time: 0.252635 Aug 10 17:21:23.038785 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 476/935] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:22 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1671 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:21:24.061913 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0be89616-fe67-4fca-b5ec-c48e179ae183 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:24.062579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0be89616-fe67-4fca-b5ec-c48e179ae183 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:24.069492 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0be89616-fe67-4fca-b5ec-c48e179ae183 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:24.070171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0be89616-fe67-4fca-b5ec-c48e179ae183 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:24.071069 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0be89616-fe67-4fca-b5ec-c48e179ae183 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:24.071874 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0be89616-fe67-4fca-b5ec-c48e179ae183 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:24.072261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0be89616-fe67-4fca-b5ec-c48e179ae183 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:24.072693 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0be89616-fe67-4fca-b5ec-c48e179ae183 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:24.289047 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0be89616-fe67-4fca-b5ec-c48e179ae183 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:24.297352 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0be89616-fe67-4fca-b5ec-c48e179ae183 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:24.301471 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0be89616-fe67-4fca-b5ec-c48e179ae183 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:24.301471 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0be89616-fe67-4fca-b5ec-c48e179ae183 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1673 microversion: 2.20 time: 0.243087 Aug 10 17:21:24.301471 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 460/936] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:24 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1673 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:25.327827 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ca1b4e45-9e4a-48f1-82d9-8508b75ad8ed tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:25.328799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ca1b4e45-9e4a-48f1-82d9-8508b75ad8ed tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:25.338554 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca1b4e45-9e4a-48f1-82d9-8508b75ad8ed tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:25.339327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca1b4e45-9e4a-48f1-82d9-8508b75ad8ed tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:25.340689 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca1b4e45-9e4a-48f1-82d9-8508b75ad8ed tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:25.341872 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca1b4e45-9e4a-48f1-82d9-8508b75ad8ed tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:25.342751 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca1b4e45-9e4a-48f1-82d9-8508b75ad8ed tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:25.343401 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca1b4e45-9e4a-48f1-82d9-8508b75ad8ed tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:25.490198 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ca1b4e45-9e4a-48f1-82d9-8508b75ad8ed tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:25.498580 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ca1b4e45-9e4a-48f1-82d9-8508b75ad8ed tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:25.500534 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ca1b4e45-9e4a-48f1-82d9-8508b75ad8ed tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:25.501705 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ca1b4e45-9e4a-48f1-82d9-8508b75ad8ed tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.180830 Aug 10 17:21:25.502369 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 477/937] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:25 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:25.792739 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fd21e151-0f9b-4355-8676-f14ae19cf999 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:21:25.795083 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fd21e151-0f9b-4355-8676-f14ae19cf999 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:25.802790 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd21e151-0f9b-4355-8676-f14ae19cf999 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:25.803528 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd21e151-0f9b-4355-8676-f14ae19cf999 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:25.804229 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd21e151-0f9b-4355-8676-f14ae19cf999 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:25.805041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd21e151-0f9b-4355-8676-f14ae19cf999 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:25.805602 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd21e151-0f9b-4355-8676-f14ae19cf999 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:25.806205 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd21e151-0f9b-4355-8676-f14ae19cf999 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:26.067018 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fd21e151-0f9b-4355-8676-f14ae19cf999 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "POST /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5/action" status: 200 len: 28700 microversion: 2.1 time: 0.279524 Aug 10 17:21:26.068086 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 461/938] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:21:25 2022] POST /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5/action => generated 28700 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 17:21:26.525654 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3003e38e-04b2-45ca-a822-7a7b0a15b2fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:26.526280 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3003e38e-04b2-45ca-a822-7a7b0a15b2fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:26.533778 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3003e38e-04b2-45ca-a822-7a7b0a15b2fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:26.534046 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3003e38e-04b2-45ca-a822-7a7b0a15b2fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:26.534384 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3003e38e-04b2-45ca-a822-7a7b0a15b2fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:26.535208 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3003e38e-04b2-45ca-a822-7a7b0a15b2fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:26.535668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3003e38e-04b2-45ca-a822-7a7b0a15b2fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:26.536153 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3003e38e-04b2-45ca-a822-7a7b0a15b2fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:26.705790 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3003e38e-04b2-45ca-a822-7a7b0a15b2fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:26.724769 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3003e38e-04b2-45ca-a822-7a7b0a15b2fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:26.727146 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3003e38e-04b2-45ca-a822-7a7b0a15b2fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:26.729147 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3003e38e-04b2-45ca-a822-7a7b0a15b2fd tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.207516 Aug 10 17:21:26.730434 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 478/939] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:26 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:27.748143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0967d8cc-fb1f-41d5-941c-8c19bc86ad1b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:27.748922 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0967d8cc-fb1f-41d5-941c-8c19bc86ad1b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:27.749902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-ae9a2d7f-3576-4dcf-ae8c-94dfe3068dfc req-2c53a1d5-1631-4c82-bdde-49d8dff4eebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fd70709-57e7-4c56-8fc9-3b7a4004f4f5", "tag": "9fbbe438-9def-4137-b2cc-411f0ed52ac0"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:21:27.762848 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ae9a2d7f-3576-4dcf-ae8c-94dfe3068dfc req-2c53a1d5-1631-4c82-bdde-49d8dff4eebd service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:27.763924 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ae9a2d7f-3576-4dcf-ae8c-94dfe3068dfc req-2c53a1d5-1631-4c82-bdde-49d8dff4eebd service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:27.764547 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0967d8cc-fb1f-41d5-941c-8c19bc86ad1b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:27.764874 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ae9a2d7f-3576-4dcf-ae8c-94dfe3068dfc req-2c53a1d5-1631-4c82-bdde-49d8dff4eebd service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:27.765047 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0967d8cc-fb1f-41d5-941c-8c19bc86ad1b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:27.765486 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0967d8cc-fb1f-41d5-941c-8c19bc86ad1b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:27.766189 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0967d8cc-fb1f-41d5-941c-8c19bc86ad1b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:27.766671 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0967d8cc-fb1f-41d5-941c-8c19bc86ad1b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:27.767093 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0967d8cc-fb1f-41d5-941c-8c19bc86ad1b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:27.777689 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-ae9a2d7f-3576-4dcf-ae8c-94dfe3068dfc req-2c53a1d5-1631-4c82-bdde-49d8dff4eebd service nova] Creating event network-changed:9fbbe438-9def-4137-b2cc-411f0ed52ac0 for instance 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 on hv-cinder-85272 Aug 10 17:21:27.783314 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-ae9a2d7f-3576-4dcf-ae8c-94dfe3068dfc req-2c53a1d5-1631-4c82-bdde-49d8dff4eebd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037036 Aug 10 17:21:27.785843 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 479/940] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:27.798838 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b9da91e1-4731-4d80-a721-055938019dd2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:27.798838 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b9da91e1-4731-4d80-a721-055938019dd2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:27.801032 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9da91e1-4731-4d80-a721-055938019dd2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:27.801822 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9da91e1-4731-4d80-a721-055938019dd2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:27.802914 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9da91e1-4731-4d80-a721-055938019dd2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:27.804046 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9da91e1-4731-4d80-a721-055938019dd2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:27.804952 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9da91e1-4731-4d80-a721-055938019dd2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:27.805597 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9da91e1-4731-4d80-a721-055938019dd2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:27.835042 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0967d8cc-fb1f-41d5-941c-8c19bc86ad1b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:21:28.068527 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b9da91e1-4731-4d80-a721-055938019dd2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:28.084348 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b9da91e1-4731-4d80-a721-055938019dd2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:28.088425 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b9da91e1-4731-4d80-a721-055938019dd2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:28.092976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b9da91e1-4731-4d80-a721-055938019dd2 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.303051 Aug 10 17:21:28.092976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 480/941] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:27 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:28.292089 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0967d8cc-fb1f-41d5-941c-8c19bc86ad1b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 204 len: 0 microversion: 2.1 time: 0.548872 Aug 10 17:21:28.293589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 462/942] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:21:27 2022] DELETE /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:21:28.306323 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-43d0df8a-fac9-4af1-98eb-830cd6c46a60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:28.307115 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-43d0df8a-fac9-4af1-98eb-830cd6c46a60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:28.319785 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43d0df8a-fac9-4af1-98eb-830cd6c46a60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:28.320510 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43d0df8a-fac9-4af1-98eb-830cd6c46a60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:28.321919 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43d0df8a-fac9-4af1-98eb-830cd6c46a60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:28.327559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43d0df8a-fac9-4af1-98eb-830cd6c46a60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:28.329386 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43d0df8a-fac9-4af1-98eb-830cd6c46a60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:28.330015 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43d0df8a-fac9-4af1-98eb-830cd6c46a60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:28.369493 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9bd0e76a-e6b6-4419-9fb0-bd4cbda42b95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:28.370294 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9bd0e76a-e6b6-4419-9fb0-bd4cbda42b95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:28.412267 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9bd0e76a-e6b6-4419-9fb0-bd4cbda42b95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:28.415362 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9bd0e76a-e6b6-4419-9fb0-bd4cbda42b95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:28.416064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9bd0e76a-e6b6-4419-9fb0-bd4cbda42b95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:28.420805 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9bd0e76a-e6b6-4419-9fb0-bd4cbda42b95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:28.423092 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9bd0e76a-e6b6-4419-9fb0-bd4cbda42b95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:28.424269 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9bd0e76a-e6b6-4419-9fb0-bd4cbda42b95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:28.636895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-9bd0e76a-e6b6-4419-9fb0-bd4cbda42b95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lazy-loading 'services' on Instance uuid d76607cf-e08a-4b20-8edb-4fef90a17fb9 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:21:28.664136 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-43d0df8a-fac9-4af1-98eb-830cd6c46a60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:28.673481 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-43d0df8a-fac9-4af1-98eb-830cd6c46a60 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1578 microversion: 2.1 time: 0.371093 Aug 10 17:21:28.679642 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 481/943] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:28 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1578 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:28.927349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9bd0e76a-e6b6-4419-9fb0-bd4cbda42b95 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments/e724587b-69a1-4142-8962-fc92d97bfdd5" status: 202 len: 0 microversion: 2.1 time: 0.566407 Aug 10 17:21:28.931487 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 463/944] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 17:21:28 2022] DELETE /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments/e724587b-69a1-4142-8962-fc92d97bfdd5 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:21:28.938685 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5717d78c-2280-42e5-9ae6-920a7b4af25f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:28.941705 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5717d78c-2280-42e5-9ae6-920a7b4af25f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:28.949428 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5717d78c-2280-42e5-9ae6-920a7b4af25f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:28.951382 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5717d78c-2280-42e5-9ae6-920a7b4af25f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:28.951382 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5717d78c-2280-42e5-9ae6-920a7b4af25f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:28.951382 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5717d78c-2280-42e5-9ae6-920a7b4af25f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:28.951675 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5717d78c-2280-42e5-9ae6-920a7b4af25f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:28.952039 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5717d78c-2280-42e5-9ae6-920a7b4af25f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:29.008321 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5717d78c-2280-42e5-9ae6-920a7b4af25f tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074697 Aug 10 17:21:29.010485 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 482/945] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:21:28 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:29.124633 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9935d599-a3a8-42bd-8825-1d55d3822496 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:29.125748 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9935d599-a3a8-42bd-8825-1d55d3822496 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:29.133111 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9935d599-a3a8-42bd-8825-1d55d3822496 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:29.133959 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9935d599-a3a8-42bd-8825-1d55d3822496 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:29.134641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9935d599-a3a8-42bd-8825-1d55d3822496 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:29.135620 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9935d599-a3a8-42bd-8825-1d55d3822496 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:29.136411 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9935d599-a3a8-42bd-8825-1d55d3822496 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:29.137084 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9935d599-a3a8-42bd-8825-1d55d3822496 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:29.337656 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9935d599-a3a8-42bd-8825-1d55d3822496 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:29.341966 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=8,nova_cell1:INSERT=7 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:21:29.348354 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9935d599-a3a8-42bd-8825-1d55d3822496 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:29.358844 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9935d599-a3a8-42bd-8825-1d55d3822496 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:29.358844 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9935d599-a3a8-42bd-8825-1d55d3822496 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.235577 Aug 10 17:21:29.358844 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 464/946] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:29 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:29.696897 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e7ae2fa7-0245-4e4f-9759-0484543bd065 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:29.697799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e7ae2fa7-0245-4e4f-9759-0484543bd065 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:29.704530 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7ae2fa7-0245-4e4f-9759-0484543bd065 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:29.705672 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7ae2fa7-0245-4e4f-9759-0484543bd065 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:29.706969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7ae2fa7-0245-4e4f-9759-0484543bd065 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:29.708173 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7ae2fa7-0245-4e4f-9759-0484543bd065 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:29.708798 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7ae2fa7-0245-4e4f-9759-0484543bd065 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:29.709550 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7ae2fa7-0245-4e4f-9759-0484543bd065 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:29.872154 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e7ae2fa7-0245-4e4f-9759-0484543bd065 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:29.880896 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e7ae2fa7-0245-4e4f-9759-0484543bd065 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1578 microversion: 2.1 time: 0.188378 Aug 10 17:21:29.881467 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 483/947] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:29 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:30.025389 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2b307abd-7f4b-4b29-b858-739a20b5d093 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:30.028764 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2b307abd-7f4b-4b29-b858-739a20b5d093 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:30.038720 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b307abd-7f4b-4b29-b858-739a20b5d093 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:30.039700 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b307abd-7f4b-4b29-b858-739a20b5d093 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:30.040372 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b307abd-7f4b-4b29-b858-739a20b5d093 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:30.041866 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b307abd-7f4b-4b29-b858-739a20b5d093 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:30.042729 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b307abd-7f4b-4b29-b858-739a20b5d093 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:30.043415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b307abd-7f4b-4b29-b858-739a20b5d093 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:30.083718 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2b307abd-7f4b-4b29-b858-739a20b5d093 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065866 Aug 10 17:21:30.085085 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 465/948] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:21:30 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:30.387510 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-700d7282-c204-406d-9907-2c6c483a0eec tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:30.388121 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-700d7282-c204-406d-9907-2c6c483a0eec tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:30.400593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-700d7282-c204-406d-9907-2c6c483a0eec tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:30.400593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-700d7282-c204-406d-9907-2c6c483a0eec tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:30.400593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-700d7282-c204-406d-9907-2c6c483a0eec tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:30.400593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-700d7282-c204-406d-9907-2c6c483a0eec tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:30.401114 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-700d7282-c204-406d-9907-2c6c483a0eec tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:30.401114 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-700d7282-c204-406d-9907-2c6c483a0eec tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:30.561160 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-700d7282-c204-406d-9907-2c6c483a0eec tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:30.561609 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-700d7282-c204-406d-9907-2c6c483a0eec tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:30.563477 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-700d7282-c204-406d-9907-2c6c483a0eec tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:30.564963 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-700d7282-c204-406d-9907-2c6c483a0eec tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.181560 Aug 10 17:21:30.567496 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 484/949] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:30 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:30.903856 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8f8177a9-5e7a-45c0-8f65-bd0f3d0162fb tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:30.904976 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8f8177a9-5e7a-45c0-8f65-bd0f3d0162fb tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:30.911959 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f8177a9-5e7a-45c0-8f65-bd0f3d0162fb tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:30.912450 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f8177a9-5e7a-45c0-8f65-bd0f3d0162fb tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:30.912885 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f8177a9-5e7a-45c0-8f65-bd0f3d0162fb tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:30.913592 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f8177a9-5e7a-45c0-8f65-bd0f3d0162fb tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:30.914049 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f8177a9-5e7a-45c0-8f65-bd0f3d0162fb tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:30.914524 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f8177a9-5e7a-45c0-8f65-bd0f3d0162fb tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:31.058261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8f8177a9-5e7a-45c0-8f65-bd0f3d0162fb tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:31.071301 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8f8177a9-5e7a-45c0-8f65-bd0f3d0162fb tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1578 microversion: 2.1 time: 0.171841 Aug 10 17:21:31.072034 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 466/950] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:30 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:31.098369 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f6926ce7-1500-42cb-9440-9fadfec7643c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:31.100791 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f6926ce7-1500-42cb-9440-9fadfec7643c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:31.107003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6926ce7-1500-42cb-9440-9fadfec7643c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:31.107499 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6926ce7-1500-42cb-9440-9fadfec7643c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:31.107942 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6926ce7-1500-42cb-9440-9fadfec7643c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:31.108682 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6926ce7-1500-42cb-9440-9fadfec7643c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:31.109137 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6926ce7-1500-42cb-9440-9fadfec7643c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:31.109563 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6926ce7-1500-42cb-9440-9fadfec7643c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:31.150031 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f6926ce7-1500-42cb-9440-9fadfec7643c tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057057 Aug 10 17:21:31.150634 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 485/951] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:21:31 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:31.589533 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2f0ebf3b-9679-44e5-b1a7-f936110cab5b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:31.590144 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2f0ebf3b-9679-44e5-b1a7-f936110cab5b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:31.598186 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2f0ebf3b-9679-44e5-b1a7-f936110cab5b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:31.599119 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2f0ebf3b-9679-44e5-b1a7-f936110cab5b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:31.599722 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2f0ebf3b-9679-44e5-b1a7-f936110cab5b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:31.600711 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2f0ebf3b-9679-44e5-b1a7-f936110cab5b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:31.601116 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2f0ebf3b-9679-44e5-b1a7-f936110cab5b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:31.601568 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2f0ebf3b-9679-44e5-b1a7-f936110cab5b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:31.789684 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2f0ebf3b-9679-44e5-b1a7-f936110cab5b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:31.798704 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2f0ebf3b-9679-44e5-b1a7-f936110cab5b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:31.800931 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2f0ebf3b-9679-44e5-b1a7-f936110cab5b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:31.802546 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2f0ebf3b-9679-44e5-b1a7-f936110cab5b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.216695 Aug 10 17:21:31.809036 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 467/952] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:31 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:21:32.094433 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5f60cda7-b8aa-4e13-bc49-5da9b32ed669 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:32.095199 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5f60cda7-b8aa-4e13-bc49-5da9b32ed669 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:32.112082 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f60cda7-b8aa-4e13-bc49-5da9b32ed669 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:32.114548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f60cda7-b8aa-4e13-bc49-5da9b32ed669 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:32.115324 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f60cda7-b8aa-4e13-bc49-5da9b32ed669 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:32.116547 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f60cda7-b8aa-4e13-bc49-5da9b32ed669 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:32.117367 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f60cda7-b8aa-4e13-bc49-5da9b32ed669 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:32.118456 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f60cda7-b8aa-4e13-bc49-5da9b32ed669 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:32.180770 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b39e1d81-38a6-4d36-9160-d5842519bd42 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:32.183126 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b39e1d81-38a6-4d36-9160-d5842519bd42 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:32.186687 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:21:32.190644 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b39e1d81-38a6-4d36-9160-d5842519bd42 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:32.191363 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b39e1d81-38a6-4d36-9160-d5842519bd42 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:32.191969 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b39e1d81-38a6-4d36-9160-d5842519bd42 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:32.192838 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b39e1d81-38a6-4d36-9160-d5842519bd42 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:32.193444 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b39e1d81-38a6-4d36-9160-d5842519bd42 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:32.194026 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b39e1d81-38a6-4d36-9160-d5842519bd42 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:32.242073 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b39e1d81-38a6-4d36-9160-d5842519bd42 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077818 Aug 10 17:21:32.243447 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 468/953] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:21:32 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:32.283135 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5f60cda7-b8aa-4e13-bc49-5da9b32ed669 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:32.291831 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5f60cda7-b8aa-4e13-bc49-5da9b32ed669 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1578 microversion: 2.1 time: 0.202327 Aug 10 17:21:32.292611 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 486/954] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:32 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1578 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:32.827259 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1c372bc0-37d0-4621-ba11-d6430b7ba67e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:32.827808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1c372bc0-37d0-4621-ba11-d6430b7ba67e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:32.835234 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c372bc0-37d0-4621-ba11-d6430b7ba67e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:32.835881 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c372bc0-37d0-4621-ba11-d6430b7ba67e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:32.836264 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c372bc0-37d0-4621-ba11-d6430b7ba67e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:32.837003 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c372bc0-37d0-4621-ba11-d6430b7ba67e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:32.837569 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c372bc0-37d0-4621-ba11-d6430b7ba67e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:32.838009 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c372bc0-37d0-4621-ba11-d6430b7ba67e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:32.992610 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1c372bc0-37d0-4621-ba11-d6430b7ba67e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:33.001709 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1c372bc0-37d0-4621-ba11-d6430b7ba67e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:33.003944 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1c372bc0-37d0-4621-ba11-d6430b7ba67e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:33.005140 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1c372bc0-37d0-4621-ba11-d6430b7ba67e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.182115 Aug 10 17:21:33.037122 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 469/955] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:32 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:33.262604 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1a6f3214-c48c-49e8-9124-d53858d58a12 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:33.265631 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1a6f3214-c48c-49e8-9124-d53858d58a12 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:33.272715 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1a6f3214-c48c-49e8-9124-d53858d58a12 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:33.273288 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1a6f3214-c48c-49e8-9124-d53858d58a12 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:33.273803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1a6f3214-c48c-49e8-9124-d53858d58a12 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:33.274630 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1a6f3214-c48c-49e8-9124-d53858d58a12 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:33.275165 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1a6f3214-c48c-49e8-9124-d53858d58a12 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:33.275665 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1a6f3214-c48c-49e8-9124-d53858d58a12 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:33.310409 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1a6f3214-c48c-49e8-9124-d53858d58a12 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053971 Aug 10 17:21:33.312862 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6d25cd9d-be98-4b65-b201-fdcbe9e2c6d6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:33.313482 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6d25cd9d-be98-4b65-b201-fdcbe9e2c6d6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:33.315237 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 487/956] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:21:33 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:33.321070 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d25cd9d-be98-4b65-b201-fdcbe9e2c6d6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:33.321887 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d25cd9d-be98-4b65-b201-fdcbe9e2c6d6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:33.322600 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d25cd9d-be98-4b65-b201-fdcbe9e2c6d6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:33.323654 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d25cd9d-be98-4b65-b201-fdcbe9e2c6d6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:33.324328 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d25cd9d-be98-4b65-b201-fdcbe9e2c6d6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:33.325037 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d25cd9d-be98-4b65-b201-fdcbe9e2c6d6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:33.494995 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6d25cd9d-be98-4b65-b201-fdcbe9e2c6d6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:33.499478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6d25cd9d-be98-4b65-b201-fdcbe9e2c6d6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1578 microversion: 2.1 time: 0.190247 Aug 10 17:21:33.500426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 470/957] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:33 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:34.029543 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-38bc8ecf-535b-44ab-8539-b51a30a7a2a9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:34.030162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-38bc8ecf-535b-44ab-8539-b51a30a7a2a9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:34.032342 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=70 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:21:34.038250 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38bc8ecf-535b-44ab-8539-b51a30a7a2a9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:34.039134 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38bc8ecf-535b-44ab-8539-b51a30a7a2a9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:34.039652 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38bc8ecf-535b-44ab-8539-b51a30a7a2a9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:34.040439 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38bc8ecf-535b-44ab-8539-b51a30a7a2a9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:34.040975 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38bc8ecf-535b-44ab-8539-b51a30a7a2a9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:34.041478 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38bc8ecf-535b-44ab-8539-b51a30a7a2a9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:34.189600 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-38bc8ecf-535b-44ab-8539-b51a30a7a2a9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:34.202656 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-38bc8ecf-535b-44ab-8539-b51a30a7a2a9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:34.204505 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-38bc8ecf-535b-44ab-8539-b51a30a7a2a9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:34.206636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-38bc8ecf-535b-44ab-8539-b51a30a7a2a9 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.180309 Aug 10 17:21:34.222905 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 488/958] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:34 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:34.323175 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-34ac53fe-709b-45b3-b59e-a9b574fb1936 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:34.326049 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-34ac53fe-709b-45b3-b59e-a9b574fb1936 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:34.334444 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34ac53fe-709b-45b3-b59e-a9b574fb1936 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:34.335292 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34ac53fe-709b-45b3-b59e-a9b574fb1936 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:34.336018 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34ac53fe-709b-45b3-b59e-a9b574fb1936 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:34.337053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34ac53fe-709b-45b3-b59e-a9b574fb1936 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:34.337534 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34ac53fe-709b-45b3-b59e-a9b574fb1936 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:34.338134 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34ac53fe-709b-45b3-b59e-a9b574fb1936 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:34.375057 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-34ac53fe-709b-45b3-b59e-a9b574fb1936 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056197 Aug 10 17:21:34.376554 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 471/959] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:21:34 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:34.526448 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8d36bd82-7f44-4a0d-9ebd-f9a2d9f7d75b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:34.527065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8d36bd82-7f44-4a0d-9ebd-f9a2d9f7d75b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:34.533350 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d36bd82-7f44-4a0d-9ebd-f9a2d9f7d75b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:34.533833 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d36bd82-7f44-4a0d-9ebd-f9a2d9f7d75b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:34.534906 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d36bd82-7f44-4a0d-9ebd-f9a2d9f7d75b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:34.535723 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d36bd82-7f44-4a0d-9ebd-f9a2d9f7d75b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:34.536175 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d36bd82-7f44-4a0d-9ebd-f9a2d9f7d75b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:34.536601 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d36bd82-7f44-4a0d-9ebd-f9a2d9f7d75b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:34.681428 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8d36bd82-7f44-4a0d-9ebd-f9a2d9f7d75b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:34.689276 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8d36bd82-7f44-4a0d-9ebd-f9a2d9f7d75b tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1578 microversion: 2.1 time: 0.167215 Aug 10 17:21:34.689851 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 489/960] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:34 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:35.232236 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-411a8de1-2eff-457c-8112-ca0d85cfadc1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:35.232898 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-411a8de1-2eff-457c-8112-ca0d85cfadc1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:35.239205 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-411a8de1-2eff-457c-8112-ca0d85cfadc1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:35.239702 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-411a8de1-2eff-457c-8112-ca0d85cfadc1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:35.240139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-411a8de1-2eff-457c-8112-ca0d85cfadc1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:35.240838 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-411a8de1-2eff-457c-8112-ca0d85cfadc1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:35.241294 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-411a8de1-2eff-457c-8112-ca0d85cfadc1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:35.241723 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-411a8de1-2eff-457c-8112-ca0d85cfadc1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:35.375334 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-411a8de1-2eff-457c-8112-ca0d85cfadc1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:35.384816 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-411a8de1-2eff-457c-8112-ca0d85cfadc1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:35.387050 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-411a8de1-2eff-457c-8112-ca0d85cfadc1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:35.388566 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-411a8de1-2eff-457c-8112-ca0d85cfadc1 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.160380 Aug 10 17:21:35.389275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a602cb15-07f4-47e0-9339-29af5fce9691 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:35.392719 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a602cb15-07f4-47e0-9339-29af5fce9691 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:35.398809 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a602cb15-07f4-47e0-9339-29af5fce9691 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:35.398979 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 472/961] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:35 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:35.399632 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a602cb15-07f4-47e0-9339-29af5fce9691 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:35.400071 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a602cb15-07f4-47e0-9339-29af5fce9691 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:35.400771 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a602cb15-07f4-47e0-9339-29af5fce9691 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:35.401226 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a602cb15-07f4-47e0-9339-29af5fce9691 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:35.401731 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a602cb15-07f4-47e0-9339-29af5fce9691 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:35.431027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a602cb15-07f4-47e0-9339-29af5fce9691 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046131 Aug 10 17:21:35.431901 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 490/962] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:21:35 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:35.712824 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e6033296-3133-4fbe-9017-c06fb10b7532 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:35.713548 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e6033296-3133-4fbe-9017-c06fb10b7532 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:35.719741 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e6033296-3133-4fbe-9017-c06fb10b7532 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:35.720224 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e6033296-3133-4fbe-9017-c06fb10b7532 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:35.720661 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e6033296-3133-4fbe-9017-c06fb10b7532 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:35.721366 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e6033296-3133-4fbe-9017-c06fb10b7532 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:35.721828 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e6033296-3133-4fbe-9017-c06fb10b7532 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:35.722301 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e6033296-3133-4fbe-9017-c06fb10b7532 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:35.861607 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e6033296-3133-4fbe-9017-c06fb10b7532 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:35.869291 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e6033296-3133-4fbe-9017-c06fb10b7532 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1578 microversion: 2.1 time: 0.160829 Aug 10 17:21:35.869850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 473/963] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:35 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:36.411945 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-948f5821-1f95-4e32-9ed4-32df8c7dcc21 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:36.412593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-948f5821-1f95-4e32-9ed4-32df8c7dcc21 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:36.418969 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-948f5821-1f95-4e32-9ed4-32df8c7dcc21 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:36.419459 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-948f5821-1f95-4e32-9ed4-32df8c7dcc21 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:36.419950 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-948f5821-1f95-4e32-9ed4-32df8c7dcc21 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:36.420780 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-948f5821-1f95-4e32-9ed4-32df8c7dcc21 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:36.421242 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-948f5821-1f95-4e32-9ed4-32df8c7dcc21 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:36.421666 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-948f5821-1f95-4e32-9ed4-32df8c7dcc21 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:36.445091 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9081dbb0-aa35-4ffc-a755-d118c8f40fbf tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:36.447480 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9081dbb0-aa35-4ffc-a755-d118c8f40fbf tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:36.453407 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9081dbb0-aa35-4ffc-a755-d118c8f40fbf tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:36.454159 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9081dbb0-aa35-4ffc-a755-d118c8f40fbf tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:36.454793 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9081dbb0-aa35-4ffc-a755-d118c8f40fbf tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:36.456267 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9081dbb0-aa35-4ffc-a755-d118c8f40fbf tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:36.456739 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9081dbb0-aa35-4ffc-a755-d118c8f40fbf tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:36.457164 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9081dbb0-aa35-4ffc-a755-d118c8f40fbf tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:36.489742 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9081dbb0-aa35-4ffc-a755-d118c8f40fbf tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049347 Aug 10 17:21:36.495575 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 474/964] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:21:36 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:21:36.820217 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-948f5821-1f95-4e32-9ed4-32df8c7dcc21 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:36.828244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-948f5821-1f95-4e32-9ed4-32df8c7dcc21 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:36.829750 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-948f5821-1f95-4e32-9ed4-32df8c7dcc21 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:36.831081 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-948f5821-1f95-4e32-9ed4-32df8c7dcc21 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.423180 Aug 10 17:21:36.841846 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 491/965] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:36 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:36.892365 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6701a3f5-4386-45f8-af52-c8e549926df4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:36.892907 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6701a3f5-4386-45f8-af52-c8e549926df4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:36.899112 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6701a3f5-4386-45f8-af52-c8e549926df4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:36.899634 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6701a3f5-4386-45f8-af52-c8e549926df4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:36.900072 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6701a3f5-4386-45f8-af52-c8e549926df4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:36.900791 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6701a3f5-4386-45f8-af52-c8e549926df4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:36.901248 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6701a3f5-4386-45f8-af52-c8e549926df4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:36.901678 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6701a3f5-4386-45f8-af52-c8e549926df4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:37.048267 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6701a3f5-4386-45f8-af52-c8e549926df4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:37.056790 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6701a3f5-4386-45f8-af52-c8e549926df4 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1578 microversion: 2.1 time: 0.168413 Aug 10 17:21:37.057416 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 475/966] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:36 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:37.501294 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0649588c-e53d-44e0-9135-f610b208dfff tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:37.504233 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0649588c-e53d-44e0-9135-f610b208dfff tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:37.511151 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0649588c-e53d-44e0-9135-f610b208dfff tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:37.511630 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0649588c-e53d-44e0-9135-f610b208dfff tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:37.512068 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0649588c-e53d-44e0-9135-f610b208dfff tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:37.512758 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0649588c-e53d-44e0-9135-f610b208dfff tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:37.513207 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0649588c-e53d-44e0-9135-f610b208dfff tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:37.513627 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0649588c-e53d-44e0-9135-f610b208dfff tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:37.554758 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0649588c-e53d-44e0-9135-f610b208dfff tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057338 Aug 10 17:21:37.555323 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 492/967] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:21:37 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:37.853321 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2d7e6bed-c892-43be-b820-f6ff86f637a0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:37.853989 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2d7e6bed-c892-43be-b820-f6ff86f637a0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:37.860357 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2d7e6bed-c892-43be-b820-f6ff86f637a0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:37.860844 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2d7e6bed-c892-43be-b820-f6ff86f637a0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:37.861285 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2d7e6bed-c892-43be-b820-f6ff86f637a0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:37.862627 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2d7e6bed-c892-43be-b820-f6ff86f637a0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:37.863242 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2d7e6bed-c892-43be-b820-f6ff86f637a0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:37.863682 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2d7e6bed-c892-43be-b820-f6ff86f637a0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:38.033309 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2d7e6bed-c892-43be-b820-f6ff86f637a0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:38.052219 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2d7e6bed-c892-43be-b820-f6ff86f637a0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:38.053772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2d7e6bed-c892-43be-b820-f6ff86f637a0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:38.059751 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2d7e6bed-c892-43be-b820-f6ff86f637a0 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.205981 Aug 10 17:21:38.059751 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 476/968] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:37 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:38.079793 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e182b634-4810-4dd5-a584-363991782731 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:38.084683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e182b634-4810-4dd5-a584-363991782731 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:38.092922 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e182b634-4810-4dd5-a584-363991782731 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:38.094466 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e182b634-4810-4dd5-a584-363991782731 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:38.102071 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e182b634-4810-4dd5-a584-363991782731 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:38.102071 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e182b634-4810-4dd5-a584-363991782731 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:38.102071 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e182b634-4810-4dd5-a584-363991782731 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:38.102071 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e182b634-4810-4dd5-a584-363991782731 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:38.124172 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:21:38.253076 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e182b634-4810-4dd5-a584-363991782731 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:38.266104 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e182b634-4810-4dd5-a584-363991782731 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1578 microversion: 2.1 time: 0.191495 Aug 10 17:21:38.267536 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 493/969] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:38 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:38.574018 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-909e502a-fc44-4ea9-a2b3-eefdd1a07c4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:38.574233 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-909e502a-fc44-4ea9-a2b3-eefdd1a07c4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:38.582425 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-909e502a-fc44-4ea9-a2b3-eefdd1a07c4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:38.583163 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-909e502a-fc44-4ea9-a2b3-eefdd1a07c4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:38.583599 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-909e502a-fc44-4ea9-a2b3-eefdd1a07c4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:38.584695 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-909e502a-fc44-4ea9-a2b3-eefdd1a07c4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:38.585587 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-909e502a-fc44-4ea9-a2b3-eefdd1a07c4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:38.586017 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-909e502a-fc44-4ea9-a2b3-eefdd1a07c4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:38.620137 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-909e502a-fc44-4ea9-a2b3-eefdd1a07c4e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055289 Aug 10 17:21:38.620852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 477/970] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:21:38 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:21:38.688683 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4bb717ed-1a94-4f94-952b-3ac41ff70c2d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:38.689234 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4bb717ed-1a94-4f94-952b-3ac41ff70c2d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:38.696604 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4bb717ed-1a94-4f94-952b-3ac41ff70c2d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:38.697083 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4bb717ed-1a94-4f94-952b-3ac41ff70c2d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:38.697529 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4bb717ed-1a94-4f94-952b-3ac41ff70c2d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:38.698232 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4bb717ed-1a94-4f94-952b-3ac41ff70c2d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:38.698814 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4bb717ed-1a94-4f94-952b-3ac41ff70c2d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:38.699244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4bb717ed-1a94-4f94-952b-3ac41ff70c2d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:38.709206 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-523a8b07-a45e-4e0d-8c3d-4a59f83cdc06 req-1fa2916e-763a-4e7c-9090-9d12f1a9950f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd70709-57e7-4c56-8fc9-3b7a4004f4f5", "name": "network-vif-deleted", "tag": "9fbbe438-9def-4137-b2cc-411f0ed52ac0"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:21:38.719273 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-523a8b07-a45e-4e0d-8c3d-4a59f83cdc06 req-1fa2916e-763a-4e7c-9090-9d12f1a9950f service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:38.722056 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-523a8b07-a45e-4e0d-8c3d-4a59f83cdc06 req-1fa2916e-763a-4e7c-9090-9d12f1a9950f service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:38.722056 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-523a8b07-a45e-4e0d-8c3d-4a59f83cdc06 req-1fa2916e-763a-4e7c-9090-9d12f1a9950f service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:38.733531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-523a8b07-a45e-4e0d-8c3d-4a59f83cdc06 req-1fa2916e-763a-4e7c-9090-9d12f1a9950f service nova] Creating event network-vif-deleted:9fbbe438-9def-4137-b2cc-411f0ed52ac0 for instance 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 on hv-cinder-85272 Aug 10 17:21:38.734247 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4bb717ed-1a94-4f94-952b-3ac41ff70c2d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:21:38.740534 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-523a8b07-a45e-4e0d-8c3d-4a59f83cdc06 req-1fa2916e-763a-4e7c-9090-9d12f1a9950f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035360 Aug 10 17:21:38.741146 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 478/971] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:21:39.083739 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1075a656-76ce-4344-b5c9-f0caafafff93 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:39.084455 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1075a656-76ce-4344-b5c9-f0caafafff93 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:39.090945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1075a656-76ce-4344-b5c9-f0caafafff93 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:39.091434 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1075a656-76ce-4344-b5c9-f0caafafff93 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:39.091874 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1075a656-76ce-4344-b5c9-f0caafafff93 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:39.092608 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1075a656-76ce-4344-b5c9-f0caafafff93 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:39.093067 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1075a656-76ce-4344-b5c9-f0caafafff93 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:39.093492 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1075a656-76ce-4344-b5c9-f0caafafff93 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:39.236684 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1075a656-76ce-4344-b5c9-f0caafafff93 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:39.250269 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1075a656-76ce-4344-b5c9-f0caafafff93 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:39.299169 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1075a656-76ce-4344-b5c9-f0caafafff93 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:39.299169 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1075a656-76ce-4344-b5c9-f0caafafff93 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.175144 Aug 10 17:21:39.299169 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 479/972] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:39 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 17:21:39.299169 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2edca67d-b1a2-4766-acaf-eb81f15272f8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:39.301587 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2edca67d-b1a2-4766-acaf-eb81f15272f8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:39.301587 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2edca67d-b1a2-4766-acaf-eb81f15272f8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:39.301587 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2edca67d-b1a2-4766-acaf-eb81f15272f8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:39.301587 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2edca67d-b1a2-4766-acaf-eb81f15272f8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:39.302002 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2edca67d-b1a2-4766-acaf-eb81f15272f8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:39.302002 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2edca67d-b1a2-4766-acaf-eb81f15272f8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:39.302002 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2edca67d-b1a2-4766-acaf-eb81f15272f8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:39.368041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2edca67d-b1a2-4766-acaf-eb81f15272f8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:39.375931 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2edca67d-b1a2-4766-acaf-eb81f15272f8 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1225 microversion: 2.1 time: 0.091852 Aug 10 17:21:39.376496 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 480/973] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:39 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:21:39.984065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4bb717ed-1a94-4f94-952b-3ac41ff70c2d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 204 len: 0 microversion: 2.1 time: 1.299101 Aug 10 17:21:39.984717 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 494/974] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:21:38 2022] DELETE /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 0 bytes in 1301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:21:39.993158 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-21b111fa-7798-4423-a21b-10f99e76ffb2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:39.993768 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-21b111fa-7798-4423-a21b-10f99e76ffb2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:39.999857 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21b111fa-7798-4423-a21b-10f99e76ffb2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:40.000344 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21b111fa-7798-4423-a21b-10f99e76ffb2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:40.000784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21b111fa-7798-4423-a21b-10f99e76ffb2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:40.001483 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21b111fa-7798-4423-a21b-10f99e76ffb2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:40.001943 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21b111fa-7798-4423-a21b-10f99e76ffb2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:40.002395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21b111fa-7798-4423-a21b-10f99e76ffb2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:40.136699 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-21b111fa-7798-4423-a21b-10f99e76ffb2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:40.145861 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-21b111fa-7798-4423-a21b-10f99e76ffb2 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1680 microversion: 2.1 time: 0.156452 Aug 10 17:21:40.150384 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 481/975] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:39 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:40.277462 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5a17de94-ebe0-4305-bdc4-a2ab7eb1292f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:40.278313 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5a17de94-ebe0-4305-bdc4-a2ab7eb1292f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:40.284435 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a17de94-ebe0-4305-bdc4-a2ab7eb1292f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:40.285515 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a17de94-ebe0-4305-bdc4-a2ab7eb1292f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:40.286096 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a17de94-ebe0-4305-bdc4-a2ab7eb1292f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:40.287323 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a17de94-ebe0-4305-bdc4-a2ab7eb1292f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:40.287323 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a17de94-ebe0-4305-bdc4-a2ab7eb1292f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:40.287731 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a17de94-ebe0-4305-bdc4-a2ab7eb1292f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:40.398642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5a9af65b-d456-47e6-83ef-d6d177b6e068 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:40.407260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5a9af65b-d456-47e6-83ef-d6d177b6e068 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:40.407260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a9af65b-d456-47e6-83ef-d6d177b6e068 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:40.407260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a9af65b-d456-47e6-83ef-d6d177b6e068 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:40.407260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a9af65b-d456-47e6-83ef-d6d177b6e068 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:40.407676 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a9af65b-d456-47e6-83ef-d6d177b6e068 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:40.407769 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a9af65b-d456-47e6-83ef-d6d177b6e068 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:40.408136 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a9af65b-d456-47e6-83ef-d6d177b6e068 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:40.412414 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:21:40.433584 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5a17de94-ebe0-4305-bdc4-a2ab7eb1292f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:40.440137 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a9af65b-d456-47e6-83ef-d6d177b6e068 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:40.442006 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a9af65b-d456-47e6-83ef-d6d177b6e068 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:40.442006 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a9af65b-d456-47e6-83ef-d6d177b6e068 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:40.442242 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-5a9af65b-d456-47e6-83ef-d6d177b6e068 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lazy-loading 'fault' on Instance uuid 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:21:40.442727 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5a17de94-ebe0-4305-bdc4-a2ab7eb1292f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:40.446453 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5a17de94-ebe0-4305-bdc4-a2ab7eb1292f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:40.446581 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5a17de94-ebe0-4305-bdc4-a2ab7eb1292f tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.172986 Aug 10 17:21:40.447393 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 495/976] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:40 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:40.489810 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5a9af65b-d456-47e6-83ef-d6d177b6e068 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:40.497694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5a9af65b-d456-47e6-83ef-d6d177b6e068 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1230 microversion: 2.1 time: 0.103944 Aug 10 17:21:40.498414 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 482/977] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:40 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:21:41.167522 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5d0018e4-6278-42f0-a710-a1721d9b7f5e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:41.168143 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5d0018e4-6278-42f0-a710-a1721d9b7f5e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:41.175105 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d0018e4-6278-42f0-a710-a1721d9b7f5e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:41.175907 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d0018e4-6278-42f0-a710-a1721d9b7f5e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:41.176353 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d0018e4-6278-42f0-a710-a1721d9b7f5e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:41.177059 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d0018e4-6278-42f0-a710-a1721d9b7f5e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:41.177522 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d0018e4-6278-42f0-a710-a1721d9b7f5e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:41.177954 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d0018e4-6278-42f0-a710-a1721d9b7f5e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:41.318408 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5d0018e4-6278-42f0-a710-a1721d9b7f5e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:41.326336 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5d0018e4-6278-42f0-a710-a1721d9b7f5e tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1680 microversion: 2.1 time: 0.162978 Aug 10 17:21:41.340586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 496/978] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:41 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:41.386002 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-0b46802a-9577-4575-9452-492e645b9de6 req-f25b0fcd-1117-4b05-a59f-e2a22cf776b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7eaaa8-2f20-4c87-a62a-e855728effb1", "name": "network-vif-plugged", "status": "completed", "tag": "d08afacf-c192-4763-9246-60f0a09579d4"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:21:41.398203 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-0b46802a-9577-4575-9452-492e645b9de6 req-f25b0fcd-1117-4b05-a59f-e2a22cf776b1 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:41.398779 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-0b46802a-9577-4575-9452-492e645b9de6 req-f25b0fcd-1117-4b05-a59f-e2a22cf776b1 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:41.404213 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-0b46802a-9577-4575-9452-492e645b9de6 req-f25b0fcd-1117-4b05-a59f-e2a22cf776b1 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:41.410990 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-0b46802a-9577-4575-9452-492e645b9de6 req-f25b0fcd-1117-4b05-a59f-e2a22cf776b1 service nova] Creating event network-vif-plugged:d08afacf-c192-4763-9246-60f0a09579d4 for instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 on hv-cinder-85272 Aug 10 17:21:41.415836 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-0b46802a-9577-4575-9452-492e645b9de6 req-f25b0fcd-1117-4b05-a59f-e2a22cf776b1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034175 Aug 10 17:21:41.416431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 483/979] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:41.470401 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e6f6780f-8098-4784-844c-dec390a8ad7e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:41.471026 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e6f6780f-8098-4784-844c-dec390a8ad7e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:41.477249 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e6f6780f-8098-4784-844c-dec390a8ad7e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:41.477737 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e6f6780f-8098-4784-844c-dec390a8ad7e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:41.478180 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e6f6780f-8098-4784-844c-dec390a8ad7e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:41.478935 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e6f6780f-8098-4784-844c-dec390a8ad7e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:41.479427 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e6f6780f-8098-4784-844c-dec390a8ad7e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:41.479854 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e6f6780f-8098-4784-844c-dec390a8ad7e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:41.520805 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-671539d4-e179-412c-a709-b117868b1ee6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:41.521519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-671539d4-e179-412c-a709-b117868b1ee6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:41.528793 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-671539d4-e179-412c-a709-b117868b1ee6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:41.529290 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-671539d4-e179-412c-a709-b117868b1ee6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:41.529731 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-671539d4-e179-412c-a709-b117868b1ee6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:41.530608 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-671539d4-e179-412c-a709-b117868b1ee6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:41.531072 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-671539d4-e179-412c-a709-b117868b1ee6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:41.531500 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-671539d4-e179-412c-a709-b117868b1ee6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:41.565321 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-671539d4-e179-412c-a709-b117868b1ee6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:41.565813 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-671539d4-e179-412c-a709-b117868b1ee6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:41.566902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-671539d4-e179-412c-a709-b117868b1ee6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:41.567326 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-671539d4-e179-412c-a709-b117868b1ee6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lazy-loading 'fault' on Instance uuid 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:21:41.621703 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-671539d4-e179-412c-a709-b117868b1ee6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a5224313e04d35af7fc7802ef5d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc63782f1d4b32ab58852232df16ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:41.631575 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-671539d4-e179-412c-a709-b117868b1ee6 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 200 len: 1230 microversion: 2.1 time: 0.115092 Aug 10 17:21:41.632325 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 484/980] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:41 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 1230 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:41.673273 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e6f6780f-8098-4784-844c-dec390a8ad7e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:41.683052 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e6f6780f-8098-4784-844c-dec390a8ad7e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:41.690514 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e6f6780f-8098-4784-844c-dec390a8ad7e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:41.690514 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e6f6780f-8098-4784-844c-dec390a8ad7e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.219504 Aug 10 17:21:41.690514 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 497/981] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:41 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:42.349014 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c57ee6e4-3593-4083-b1fd-43d3851a2583 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:42.349900 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c57ee6e4-3593-4083-b1fd-43d3851a2583 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:42.356079 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c57ee6e4-3593-4083-b1fd-43d3851a2583 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:42.356603 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c57ee6e4-3593-4083-b1fd-43d3851a2583 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:42.357045 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c57ee6e4-3593-4083-b1fd-43d3851a2583 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:42.357771 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c57ee6e4-3593-4083-b1fd-43d3851a2583 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:42.358213 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c57ee6e4-3593-4083-b1fd-43d3851a2583 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:42.358685 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c57ee6e4-3593-4083-b1fd-43d3851a2583 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:42.520880 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c57ee6e4-3593-4083-b1fd-43d3851a2583 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:42.530064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c57ee6e4-3593-4083-b1fd-43d3851a2583 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1680 microversion: 2.1 time: 0.185499 Aug 10 17:21:42.530977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 485/982] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:42 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:42.651542 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e850c26d-8bc7-4b3a-9c08-0194e4c90dc9 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:42.652577 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e850c26d-8bc7-4b3a-9c08-0194e4c90dc9 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] [instance: 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:42.659511 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e850c26d-8bc7-4b3a-9c08-0194e4c90dc9 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:42.660697 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e850c26d-8bc7-4b3a-9c08-0194e4c90dc9 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:42.661147 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e850c26d-8bc7-4b3a-9c08-0194e4c90dc9 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:42.662198 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e850c26d-8bc7-4b3a-9c08-0194e4c90dc9 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:42.662790 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e850c26d-8bc7-4b3a-9c08-0194e4c90dc9 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:42.663236 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e850c26d-8bc7-4b3a-9c08-0194e4c90dc9 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:42.677838 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-e850c26d-8bc7-4b3a-9c08-0194e4c90dc9 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] HTTP exception thrown: Instance 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 could not be found. Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e850c26d-8bc7-4b3a-9c08-0194e4c90dc9 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Request method failure captured: Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 HTTP/1.1 Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-f4lATor3rBLR0W_4yQORFm8v0YDbMoWF6XfZbT37aLKwELLaCHmXXoJTabXFi8Pk3eDG6rYwNSL125kB0YiYfiZw5fCf4-4pw6Yjc7-0wGlmKMNwk-uGlJlLK_poW6IlWwtttSO_eLxfSdNPWC4xPv7ko2YV0W6NwveQ0L2xPDh6g Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: e1bc63782f1d4b32ab58852232df16ac Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-TestVolumeBootPattern-1325103741 Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:21:42.679746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:21:42.681464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e1bc63782f1d4b32ab58852232df16ac", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1bc63782f1d4b32ab58852232df16ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e1bc63782f1d4b32ab58852232df16ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1bc63782f1d4b32ab58852232df16ac"}]}] Aug 10 17:21:42.681464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-TestVolumeBootPattern-1325103741 Aug 10 17:21:42.681464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: e1bc63782f1d4b32ab58852232df16ac Aug 10 17:21:42.681464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-TestVolumeBootPattern-1325103741 Aug 10 17:21:42.681464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-TestVolumeBootPattern-1325103741-project Aug 10 17:21:42.681464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:21:42.681464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:21:42.681464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 22a5224313e04d35af7fc7802ef5d6ed Aug 10 17:21:42.681464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-TestVolumeBootPattern-1325103741-project Aug 10 17:21:42.681464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:21:42.681464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 could not be found. Aug 10 17:21:42.681464 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': '8fd70709-57e7-4c56-8fc9-3b7a4004f4f5'} Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 could not be found. Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:42.682586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 could not be found. Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 could not be found. Aug 10 17:21:42.684210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:42.685595 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e850c26d-8bc7-4b3a-9c08-0194e4c90dc9 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Returning 404 to user: Instance 8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:42.685595 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e850c26d-8bc7-4b3a-9c08-0194e4c90dc9 tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5" status: 404 len: 111 microversion: 2.1 time: 0.033580 Aug 10 17:21:42.685595 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 498/983] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:42 2022] GET /compute/v2.1/servers/8fd70709-57e7-4c56-8fc9-3b7a4004f4f5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:21:42.710971 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0a695e3b-0313-4378-8756-624b149984db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:42.711672 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0a695e3b-0313-4378-8756-624b149984db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:42.719743 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a695e3b-0313-4378-8756-624b149984db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:42.720229 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a695e3b-0313-4378-8756-624b149984db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:42.720667 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a695e3b-0313-4378-8756-624b149984db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:42.721370 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a695e3b-0313-4378-8756-624b149984db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:42.721840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a695e3b-0313-4378-8756-624b149984db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:42.722303 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a695e3b-0313-4378-8756-624b149984db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:42.867211 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0a695e3b-0313-4378-8756-624b149984db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:42.880192 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0a695e3b-0313-4378-8756-624b149984db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:42.881705 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0a695e3b-0313-4378-8756-624b149984db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:42.883267 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0a695e3b-0313-4378-8756-624b149984db tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.177019 Aug 10 17:21:42.888235 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 486/984] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:42 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:43.142343 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-8362de3f-648a-4ec4-bf79-d0ee55a45200 req-14c13dd8-4fff-42fe-98c2-c074fa99149b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d76607cf-e08a-4b20-8edb-4fef90a17fb9", "name": "network-vif-deleted", "tag": "6f7538a1-11a6-4fe2-a404-3fe6642cb47c"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:21:43.151977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-8362de3f-648a-4ec4-bf79-d0ee55a45200 req-14c13dd8-4fff-42fe-98c2-c074fa99149b service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:43.152802 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-8362de3f-648a-4ec4-bf79-d0ee55a45200 req-14c13dd8-4fff-42fe-98c2-c074fa99149b service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:43.153409 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-8362de3f-648a-4ec4-bf79-d0ee55a45200 req-14c13dd8-4fff-42fe-98c2-c074fa99149b service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:43.165687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-8362de3f-648a-4ec4-bf79-d0ee55a45200 req-14c13dd8-4fff-42fe-98c2-c074fa99149b service nova] Creating event network-vif-deleted:6f7538a1-11a6-4fe2-a404-3fe6642cb47c for instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 on hv-cinder-85272 Aug 10 17:21:43.171329 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-8362de3f-648a-4ec4-bf79-d0ee55a45200 req-14c13dd8-4fff-42fe-98c2-c074fa99149b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032008 Aug 10 17:21:43.171329 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 499/985] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:21:43.553993 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c96e7baf-b0ac-4933-a92e-b207e3b36d18 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:43.554751 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c96e7baf-b0ac-4933-a92e-b207e3b36d18 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:43.562291 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c96e7baf-b0ac-4933-a92e-b207e3b36d18 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:43.564629 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c96e7baf-b0ac-4933-a92e-b207e3b36d18 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:43.564629 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c96e7baf-b0ac-4933-a92e-b207e3b36d18 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:43.564629 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c96e7baf-b0ac-4933-a92e-b207e3b36d18 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:43.565416 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c96e7baf-b0ac-4933-a92e-b207e3b36d18 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:43.566512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c96e7baf-b0ac-4933-a92e-b207e3b36d18 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:43.676267 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c96e7baf-b0ac-4933-a92e-b207e3b36d18 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:43.684963 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c96e7baf-b0ac-4933-a92e-b207e3b36d18 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1327 microversion: 2.1 time: 0.135733 Aug 10 17:21:43.685537 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 487/986] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:43 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1327 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:43.908596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-28aab116-8abd-46f9-83f2-b2c455aae29e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:43.911098 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-28aab116-8abd-46f9-83f2-b2c455aae29e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:43.935635 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-28aab116-8abd-46f9-83f2-b2c455aae29e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:43.936131 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-28aab116-8abd-46f9-83f2-b2c455aae29e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:43.936776 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-28aab116-8abd-46f9-83f2-b2c455aae29e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:43.937489 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-28aab116-8abd-46f9-83f2-b2c455aae29e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:43.937953 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-28aab116-8abd-46f9-83f2-b2c455aae29e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:43.938553 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-28aab116-8abd-46f9-83f2-b2c455aae29e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:44.095897 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-28aab116-8abd-46f9-83f2-b2c455aae29e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:44.104485 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-28aab116-8abd-46f9-83f2-b2c455aae29e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:44.105984 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-28aab116-8abd-46f9-83f2-b2c455aae29e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:44.107444 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-28aab116-8abd-46f9-83f2-b2c455aae29e tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.204209 Aug 10 17:21:44.107992 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 500/987] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:43 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:44.347621 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-876f57db-3f42-4d09-96c5-2f9d78064e3d tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] Calling method '.version_select at 0x7f7eb9ff3700>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:44.498745 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-876f57db-3f42-4d09-96c5-2f9d78064e3d tempest-TestVolumeBootPattern-1325103741 tempest-TestVolumeBootPattern-1325103741-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1509534705" status: 202 len: 0 microversion: 2.1 time: 0.155242 Aug 10 17:21:44.499345 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 488/988] 10.222.0.45 () {58 vars in 1263 bytes} [Wed Aug 10 17:21:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1509534705 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:21:44.706397 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-83e56633-5c4b-468b-9e99-b4b9e01d48e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:44.707580 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-83e56633-5c4b-468b-9e99-b4b9e01d48e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:44.713985 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83e56633-5c4b-468b-9e99-b4b9e01d48e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:44.714720 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83e56633-5c4b-468b-9e99-b4b9e01d48e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:44.715409 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83e56633-5c4b-468b-9e99-b4b9e01d48e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:44.716113 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83e56633-5c4b-468b-9e99-b4b9e01d48e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:44.716741 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83e56633-5c4b-468b-9e99-b4b9e01d48e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:44.717644 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83e56633-5c4b-468b-9e99-b4b9e01d48e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:44.753614 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83e56633-5c4b-468b-9e99-b4b9e01d48e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:44.754159 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83e56633-5c4b-468b-9e99-b4b9e01d48e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:44.754627 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83e56633-5c4b-468b-9e99-b4b9e01d48e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:44.755080 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-83e56633-5c4b-468b-9e99-b4b9e01d48e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lazy-loading 'fault' on Instance uuid d76607cf-e08a-4b20-8edb-4fef90a17fb9 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:21:44.805312 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-83e56633-5c4b-468b-9e99-b4b9e01d48e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48feb2fc02f04e739c5e1bf7d68baa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfac2c11f1b24456a5a9efaa9112e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:44.813236 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-83e56633-5c4b-468b-9e99-b4b9e01d48e1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 200 len: 1332 microversion: 2.1 time: 0.110932 Aug 10 17:21:44.813796 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 501/989] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:44 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:21:45.131460 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d72d7e8e-0202-40ab-9990-00c18544a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:45.132370 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d72d7e8e-0202-40ab-9990-00c18544a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:45.139446 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d72d7e8e-0202-40ab-9990-00c18544a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:45.140161 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d72d7e8e-0202-40ab-9990-00c18544a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:45.140840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d72d7e8e-0202-40ab-9990-00c18544a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:45.141704 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d72d7e8e-0202-40ab-9990-00c18544a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:45.142522 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d72d7e8e-0202-40ab-9990-00c18544a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:45.143144 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d72d7e8e-0202-40ab-9990-00c18544a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:45.304313 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d72d7e8e-0202-40ab-9990-00c18544a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:45.313888 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d72d7e8e-0202-40ab-9990-00c18544a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:45.315934 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d72d7e8e-0202-40ab-9990-00c18544a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:45.318053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d72d7e8e-0202-40ab-9990-00c18544a858 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1729 microversion: 2.20 time: 0.191458 Aug 10 17:21:45.319201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 489/990] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:45 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:45.837980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ed7f392f-e471-4622-b0e7-1f9f6a2538b6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:45.838845 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ed7f392f-e471-4622-b0e7-1f9f6a2538b6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:45.849626 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7f392f-e471-4622-b0e7-1f9f6a2538b6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:45.850128 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7f392f-e471-4622-b0e7-1f9f6a2538b6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:45.850600 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7f392f-e471-4622-b0e7-1f9f6a2538b6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:45.851323 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7f392f-e471-4622-b0e7-1f9f6a2538b6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:45.851784 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7f392f-e471-4622-b0e7-1f9f6a2538b6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:45.852218 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7f392f-e471-4622-b0e7-1f9f6a2538b6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:45.887808 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-ed7f392f-e471-4622-b0e7-1f9f6a2538b6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] HTTP exception thrown: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ed7f392f-e471-4622-b0e7-1f9f6a2538b6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Request method failure captured: Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 HTTP/1.1 Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-d1JeRL-7M2oDNopDjpZUxB7lCyD6gM7mAKQjs1c_tbDXZUJQxtkwNVWBVbSkOO7nl_NecmWamydXOiC8XB5d0eHDfa5nNH50PHdLvbF4dkN-n17ApWL5TP6WLuf0j7atmVYlNbqIzfOOdPkW7Q67otg7JGz72UDMA9zNteHBnnxaI Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:21:45.889664 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:21:45.891244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cfac2c11f1b24456a5a9efaa9112e281", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}] Aug 10 17:21:45.891244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:45.891244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:45.891244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:45.891244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:45.891244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:21:45.891244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:21:45.891244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 48feb2fc02f04e739c5e1bf7d68baa16 Aug 10 17:21:45.891244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:45.891244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:21:45.891244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:45.891244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': 'd76607cf-e08a-4b20-8edb-4fef90a17fb9'} Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:45.895691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:45.897318 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:45.899773 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ed7f392f-e471-4622-b0e7-1f9f6a2538b6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Returning 404 to user: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:45.899773 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ed7f392f-e471-4622-b0e7-1f9f6a2538b6 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 404 len: 111 microversion: 2.1 time: 0.057504 Aug 10 17:21:45.900145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4d60c49b-68ef-4c4c-858b-74d135c5eee7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '.version_select at 0x7f7eba017040>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:45.900937 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 502/991] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:45 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:21:46.018741 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4d60c49b-68ef-4c4c-858b-74d135c5eee7 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2144998905" status: 202 len: 0 microversion: 2.1 time: 0.122315 Aug 10 17:21:46.020319 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 490/992] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 10 17:21:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2144998905 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 17:21:46.341391 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c149a007-ebc9-4157-821c-6581be3d808a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:46.342402 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c149a007-ebc9-4157-821c-6581be3d808a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:46.349575 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c149a007-ebc9-4157-821c-6581be3d808a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:46.352021 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c149a007-ebc9-4157-821c-6581be3d808a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:46.352021 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c149a007-ebc9-4157-821c-6581be3d808a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:46.352734 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c149a007-ebc9-4157-821c-6581be3d808a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:46.353618 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c149a007-ebc9-4157-821c-6581be3d808a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:46.354279 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c149a007-ebc9-4157-821c-6581be3d808a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:46.589859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c149a007-ebc9-4157-821c-6581be3d808a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:46.602186 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c149a007-ebc9-4157-821c-6581be3d808a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:46.606905 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c149a007-ebc9-4157-821c-6581be3d808a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:21:46.609985 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c149a007-ebc9-4157-821c-6581be3d808a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1716 microversion: 2.20 time: 0.271030 Aug 10 17:21:46.609985 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 503/993] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:21:46 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1716 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:21:48.400655 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-02a079b6-cd1a-4e5b-ab77-7fb33df51f8b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:48.401150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-02a079b6-cd1a-4e5b-ab77-7fb33df51f8b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:48.408239 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02a079b6-cd1a-4e5b-ab77-7fb33df51f8b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:48.408960 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02a079b6-cd1a-4e5b-ab77-7fb33df51f8b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:48.409503 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02a079b6-cd1a-4e5b-ab77-7fb33df51f8b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:48.410413 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02a079b6-cd1a-4e5b-ab77-7fb33df51f8b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:48.410987 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02a079b6-cd1a-4e5b-ab77-7fb33df51f8b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:48.411650 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02a079b6-cd1a-4e5b-ab77-7fb33df51f8b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:48.437445 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-02a079b6-cd1a-4e5b-ab77-7fb33df51f8b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] HTTP exception thrown: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-02a079b6-cd1a-4e5b-ab77-7fb33df51f8b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Request method failure captured: Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 HTTP/1.1 Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-d1JeRL-7M2oDNopDjpZUxB7lCyD6gM7mAKQjs1c_tbDXZUJQxtkwNVWBVbSkOO7nl_NecmWamydXOiC8XB5d0eHDfa5nNH50PHdLvbF4dkN-n17ApWL5TP6WLuf0j7atmVYlNbqIzfOOdPkW7Q67otg7JGz72UDMA9zNteHBnnxaI Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:21:48.439171 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:21:48.440606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cfac2c11f1b24456a5a9efaa9112e281", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}] Aug 10 17:21:48.440606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:48.440606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:48.440606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:48.440606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:48.440606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:21:48.440606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:21:48.440606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 48feb2fc02f04e739c5e1bf7d68baa16 Aug 10 17:21:48.440606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:48.440606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:21:48.440606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:48.440606 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': 'd76607cf-e08a-4b20-8edb-4fef90a17fb9'} Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:48.442297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:48.444395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:48.452974 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-02a079b6-cd1a-4e5b-ab77-7fb33df51f8b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Returning 404 to user: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:48.452974 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-02a079b6-cd1a-4e5b-ab77-7fb33df51f8b tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 404 len: 111 microversion: 2.1 time: 0.047904 Aug 10 17:21:48.452974 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 491/994] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:21:48 2022] DELETE /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:21:48.455187 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ed50f4fa-2779-4f5f-8c2b-897fc6e2fe37 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:48.455928 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ed50f4fa-2779-4f5f-8c2b-897fc6e2fe37 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: d76607cf-e08a-4b20-8edb-4fef90a17fb9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:48.464395 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed50f4fa-2779-4f5f-8c2b-897fc6e2fe37 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:48.465018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed50f4fa-2779-4f5f-8c2b-897fc6e2fe37 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:48.465526 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed50f4fa-2779-4f5f-8c2b-897fc6e2fe37 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:48.466339 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed50f4fa-2779-4f5f-8c2b-897fc6e2fe37 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:48.466910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed50f4fa-2779-4f5f-8c2b-897fc6e2fe37 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:48.467419 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed50f4fa-2779-4f5f-8c2b-897fc6e2fe37 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:48.484962 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-ed50f4fa-2779-4f5f-8c2b-897fc6e2fe37 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] HTTP exception thrown: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ed50f4fa-2779-4f5f-8c2b-897fc6e2fe37 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Request method failure captured: Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 HTTP/1.1 Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-d1JeRL-7M2oDNopDjpZUxB7lCyD6gM7mAKQjs1c_tbDXZUJQxtkwNVWBVbSkOO7nl_NecmWamydXOiC8XB5d0eHDfa5nNH50PHdLvbF4dkN-n17ApWL5TP6WLuf0j7atmVYlNbqIzfOOdPkW7Q67otg7JGz72UDMA9zNteHBnnxaI Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:21:48.487230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:21:48.488701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cfac2c11f1b24456a5a9efaa9112e281", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}] Aug 10 17:21:48.488701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:48.488701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:48.488701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:48.488701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:48.488701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:21:48.488701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:21:48.488701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 48feb2fc02f04e739c5e1bf7d68baa16 Aug 10 17:21:48.488701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:48.488701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:21:48.488701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:48.488701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': 'd76607cf-e08a-4b20-8edb-4fef90a17fb9'} Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:48.489636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. Aug 10 17:21:48.490910 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:48.492029 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ed50f4fa-2779-4f5f-8c2b-897fc6e2fe37 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Returning 404 to user: Instance d76607cf-e08a-4b20-8edb-4fef90a17fb9 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:48.492029 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ed50f4fa-2779-4f5f-8c2b-897fc6e2fe37 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9" status: 404 len: 111 microversion: 2.1 time: 0.038978 Aug 10 17:21:48.492029 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 504/995] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:48 2022] GET /compute/v2.1/servers/d76607cf-e08a-4b20-8edb-4fef90a17fb9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:21:49.842815 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0bf4c537-9836-49a5-bb32-c25f1a635579 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:49.850257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0bf4c537-9836-49a5-bb32-c25f1a635579 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:49.850664 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0bf4c537-9836-49a5-bb32-c25f1a635579 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:49.851157 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0bf4c537-9836-49a5-bb32-c25f1a635579 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:49.851600 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0bf4c537-9836-49a5-bb32-c25f1a635579 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:49.852305 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0bf4c537-9836-49a5-bb32-c25f1a635579 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:49.852765 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0bf4c537-9836-49a5-bb32-c25f1a635579 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:49.853195 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0bf4c537-9836-49a5-bb32-c25f1a635579 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:49.878102 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-0bf4c537-9836-49a5-bb32-c25f1a635579 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] HTTP exception thrown: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0bf4c537-9836-49a5-bb32-c25f1a635579 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Request method failure captured: Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e HTTP/1.1 Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-d1JeRL-7M2oDNopDjpZUxB7lCyD6gM7mAKQjs1c_tbDXZUJQxtkwNVWBVbSkOO7nl_NecmWamydXOiC8XB5d0eHDfa5nNH50PHdLvbF4dkN-n17ApWL5TP6WLuf0j7atmVYlNbqIzfOOdPkW7Q67otg7JGz72UDMA9zNteHBnnxaI Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:21:49.879772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:21:49.881165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cfac2c11f1b24456a5a9efaa9112e281", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}] Aug 10 17:21:49.881165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:49.881165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:49.881165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:49.881165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:49.881165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:21:49.881165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:21:49.881165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 48feb2fc02f04e739c5e1bf7d68baa16 Aug 10 17:21:49.881165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:49.881165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:21:49.881165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:21:49.881165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': 'e755ffcc-1904-43e4-b6ab-5132e4e7294e'} Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:49.882735 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:21:49.883977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.886500 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0bf4c537-9836-49a5-bb32-c25f1a635579 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Returning 404 to user: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:49.886500 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0bf4c537-9836-49a5-bb32-c25f1a635579 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 404 len: 111 microversion: 2.1 time: 0.042449 Aug 10 17:21:49.886500 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 492/996] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:21:49 2022] DELETE /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:21:49.890309 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9ce30535-54e0-4b91-9139-784e25f1c51a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:49.891255 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9ce30535-54e0-4b91-9139-784e25f1c51a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: e755ffcc-1904-43e4-b6ab-5132e4e7294e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:49.899218 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ce30535-54e0-4b91-9139-784e25f1c51a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:49.899706 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ce30535-54e0-4b91-9139-784e25f1c51a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:49.901832 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ce30535-54e0-4b91-9139-784e25f1c51a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:49.901832 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ce30535-54e0-4b91-9139-784e25f1c51a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:49.901832 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ce30535-54e0-4b91-9139-784e25f1c51a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:49.902153 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ce30535-54e0-4b91-9139-784e25f1c51a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:49.916493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-9ce30535-54e0-4b91-9139-784e25f1c51a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] HTTP exception thrown: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9ce30535-54e0-4b91-9139-784e25f1c51a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Request method failure captured: Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e HTTP/1.1 Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-d1JeRL-7M2oDNopDjpZUxB7lCyD6gM7mAKQjs1c_tbDXZUJQxtkwNVWBVbSkOO7nl_NecmWamydXOiC8XB5d0eHDfa5nNH50PHdLvbF4dkN-n17ApWL5TP6WLuf0j7atmVYlNbqIzfOOdPkW7Q67otg7JGz72UDMA9zNteHBnnxaI Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:21:49.918162 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:21:49.919800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cfac2c11f1b24456a5a9efaa9112e281", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}] Aug 10 17:21:49.919800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:49.919800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:49.919800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:49.919800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:49.919800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:21:49.919800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:21:49.919800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 48feb2fc02f04e739c5e1bf7d68baa16 Aug 10 17:21:49.919800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:49.919800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:21:49.919800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:21:49.919800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': 'e755ffcc-1904-43e4-b6ab-5132e4e7294e'} Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:49.921051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. Aug 10 17:21:49.922646 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.924053 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9ce30535-54e0-4b91-9139-784e25f1c51a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Returning 404 to user: Instance e755ffcc-1904-43e4-b6ab-5132e4e7294e could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:49.924053 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9ce30535-54e0-4b91-9139-784e25f1c51a tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e" status: 404 len: 111 microversion: 2.1 time: 0.033450 Aug 10 17:21:49.924053 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 505/997] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:49 2022] GET /compute/v2.1/servers/e755ffcc-1904-43e4-b6ab-5132e4e7294e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:21:49.928428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-39f38070-ce24-4f32-8a52-708b4e1c72df tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:49.928948 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-39f38070-ce24-4f32-8a52-708b4e1c72df tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:49.935459 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39f38070-ce24-4f32-8a52-708b4e1c72df tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:49.936135 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39f38070-ce24-4f32-8a52-708b4e1c72df tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:49.936571 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39f38070-ce24-4f32-8a52-708b4e1c72df tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:49.937305 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39f38070-ce24-4f32-8a52-708b4e1c72df tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:49.937790 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39f38070-ce24-4f32-8a52-708b4e1c72df tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:49.938215 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39f38070-ce24-4f32-8a52-708b4e1c72df tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:49.952132 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-39f38070-ce24-4f32-8a52-708b4e1c72df tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] HTTP exception thrown: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-39f38070-ce24-4f32-8a52-708b4e1c72df tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Request method failure captured: Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df HTTP/1.1 Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-d1JeRL-7M2oDNopDjpZUxB7lCyD6gM7mAKQjs1c_tbDXZUJQxtkwNVWBVbSkOO7nl_NecmWamydXOiC8XB5d0eHDfa5nNH50PHdLvbF4dkN-n17ApWL5TP6WLuf0j7atmVYlNbqIzfOOdPkW7Q67otg7JGz72UDMA9zNteHBnnxaI Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:21:49.953641 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:21:49.955251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cfac2c11f1b24456a5a9efaa9112e281", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}] Aug 10 17:21:49.955251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:49.955251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:49.955251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:49.955251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:49.955251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:21:49.955251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:21:49.955251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 48feb2fc02f04e739c5e1bf7d68baa16 Aug 10 17:21:49.955251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:49.955251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:21:49.955251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:21:49.955251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': 'ceaebb89-9428-4490-bb2f-fe34917029df'} Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:49.956053 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:21:49.957912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.959246 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-39f38070-ce24-4f32-8a52-708b4e1c72df tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Returning 404 to user: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:49.959246 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-39f38070-ce24-4f32-8a52-708b4e1c72df tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 404 len: 111 microversion: 2.1 time: 0.030566 Aug 10 17:21:49.959246 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 493/998] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:21:49 2022] DELETE /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:21:49.964546 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6eea446a-d4a6-4638-99ab-2806b060e9f1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:49.965159 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6eea446a-d4a6-4638-99ab-2806b060e9f1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: ceaebb89-9428-4490-bb2f-fe34917029df] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:49.971289 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6eea446a-d4a6-4638-99ab-2806b060e9f1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:49.971772 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6eea446a-d4a6-4638-99ab-2806b060e9f1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:49.972887 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6eea446a-d4a6-4638-99ab-2806b060e9f1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:49.973673 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6eea446a-d4a6-4638-99ab-2806b060e9f1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:49.974130 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6eea446a-d4a6-4638-99ab-2806b060e9f1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:49.974596 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6eea446a-d4a6-4638-99ab-2806b060e9f1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:49.988766 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-6eea446a-d4a6-4638-99ab-2806b060e9f1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] HTTP exception thrown: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6eea446a-d4a6-4638-99ab-2806b060e9f1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Request method failure captured: Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df HTTP/1.1 Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-d1JeRL-7M2oDNopDjpZUxB7lCyD6gM7mAKQjs1c_tbDXZUJQxtkwNVWBVbSkOO7nl_NecmWamydXOiC8XB5d0eHDfa5nNH50PHdLvbF4dkN-n17ApWL5TP6WLuf0j7atmVYlNbqIzfOOdPkW7Q67otg7JGz72UDMA9zNteHBnnxaI Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:21:49.990480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:21:49.992092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cfac2c11f1b24456a5a9efaa9112e281", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}] Aug 10 17:21:49.992092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:49.992092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:49.992092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:49.992092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:49.992092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:21:49.992092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:21:49.992092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 48feb2fc02f04e739c5e1bf7d68baa16 Aug 10 17:21:49.992092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:49.992092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:21:49.992092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:21:49.992092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': 'ceaebb89-9428-4490-bb2f-fe34917029df'} Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:49.992999 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. Aug 10 17:21:49.994479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:49.996373 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6eea446a-d4a6-4638-99ab-2806b060e9f1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Returning 404 to user: Instance ceaebb89-9428-4490-bb2f-fe34917029df could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:49.996373 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6eea446a-d4a6-4638-99ab-2806b060e9f1 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df" status: 404 len: 111 microversion: 2.1 time: 0.031144 Aug 10 17:21:49.996373 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 506/999] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:49 2022] GET /compute/v2.1/servers/ceaebb89-9428-4490-bb2f-fe34917029df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:21:51.363786 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4e7a6219-a49f-413a-876e-2a9503e5e821 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:51.365361 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4e7a6219-a49f-413a-876e-2a9503e5e821 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:51.376196 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e7a6219-a49f-413a-876e-2a9503e5e821 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:51.377153 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e7a6219-a49f-413a-876e-2a9503e5e821 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:51.378622 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e7a6219-a49f-413a-876e-2a9503e5e821 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:51.379614 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e7a6219-a49f-413a-876e-2a9503e5e821 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:51.380296 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e7a6219-a49f-413a-876e-2a9503e5e821 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:51.383037 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e7a6219-a49f-413a-876e-2a9503e5e821 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:51.405305 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-4e7a6219-a49f-413a-876e-2a9503e5e821 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] HTTP exception thrown: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4e7a6219-a49f-413a-876e-2a9503e5e821 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Request method failure captured: Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 HTTP/1.1 Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-d1JeRL-7M2oDNopDjpZUxB7lCyD6gM7mAKQjs1c_tbDXZUJQxtkwNVWBVbSkOO7nl_NecmWamydXOiC8XB5d0eHDfa5nNH50PHdLvbF4dkN-n17ApWL5TP6WLuf0j7atmVYlNbqIzfOOdPkW7Q67otg7JGz72UDMA9zNteHBnnxaI Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:21:51.407853 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:21:51.409557 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cfac2c11f1b24456a5a9efaa9112e281", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}] Aug 10 17:21:51.409557 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:51.409557 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:51.409557 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:51.409557 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:51.409557 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:21:51.409557 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:21:51.409557 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 48feb2fc02f04e739c5e1bf7d68baa16 Aug 10 17:21:51.409557 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:51.409557 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:21:51.409557 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:21:51.409557 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': 'a57e6be9-21bd-4903-a43c-425a17bf4029'} Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:51.411154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:21:51.412623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:21:51.414003 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4e7a6219-a49f-413a-876e-2a9503e5e821 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Returning 404 to user: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:51.414003 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4e7a6219-a49f-413a-876e-2a9503e5e821 tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 404 len: 111 microversion: 2.1 time: 0.053681 Aug 10 17:21:51.414003 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 494/1000] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:21:51 2022] DELETE /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:21:51.427081 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-07db53f4-d783-4c88-a59c-f7a6b9e1134d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:21:51.428393 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-07db53f4-d783-4c88-a59c-f7a6b9e1134d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] [instance: a57e6be9-21bd-4903-a43c-425a17bf4029] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:21:51.438821 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07db53f4-d783-4c88-a59c-f7a6b9e1134d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:51.439348 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07db53f4-d783-4c88-a59c-f7a6b9e1134d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:51.439791 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07db53f4-d783-4c88-a59c-f7a6b9e1134d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:51.441361 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07db53f4-d783-4c88-a59c-f7a6b9e1134d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:21:51.442257 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07db53f4-d783-4c88-a59c-f7a6b9e1134d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:21:51.442959 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07db53f4-d783-4c88-a59c-f7a6b9e1134d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:21:51.471418 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-07db53f4-d783-4c88-a59c-f7a6b9e1134d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] HTTP exception thrown: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-07db53f4-d783-4c88-a59c-f7a6b9e1134d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Request method failure captured: Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 HTTP/1.1 Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-d1JeRL-7M2oDNopDjpZUxB7lCyD6gM7mAKQjs1c_tbDXZUJQxtkwNVWBVbSkOO7nl_NecmWamydXOiC8XB5d0eHDfa5nNH50PHdLvbF4dkN-n17ApWL5TP6WLuf0j7atmVYlNbqIzfOOdPkW7Q67otg7JGz72UDMA9zNteHBnnxaI Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:21:51.473302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:21:51.475019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cfac2c11f1b24456a5a9efaa9112e281", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cfac2c11f1b24456a5a9efaa9112e281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cfac2c11f1b24456a5a9efaa9112e281"}]}] Aug 10 17:21:51.475019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:51.475019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: cfac2c11f1b24456a5a9efaa9112e281 Aug 10 17:21:51.475019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-889577527 Aug 10 17:21:51.475019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:51.475019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:21:51.475019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:21:51.475019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 48feb2fc02f04e739c5e1bf7d68baa16 Aug 10 17:21:51.475019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-889577527-project Aug 10 17:21:51.475019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:21:51.475019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:21:51.475019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': 'a57e6be9-21bd-4903-a43c-425a17bf4029'} Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:21:51.476018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. Aug 10 17:21:51.477460 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:21:51.478800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-07db53f4-d783-4c88-a59c-f7a6b9e1134d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] Returning 404 to user: Instance a57e6be9-21bd-4903-a43c-425a17bf4029 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:21:51.478800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-07db53f4-d783-4c88-a59c-f7a6b9e1134d tempest-AttachVolumeNegativeTest-889577527 tempest-AttachVolumeNegativeTest-889577527-project] 10.222.0.45 "GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029" status: 404 len: 111 microversion: 2.1 time: 0.057755 Aug 10 17:21:51.479098 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 507/1001] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:21:51 2022] GET /compute/v2.1/servers/a57e6be9-21bd-4903-a43c-425a17bf4029 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:22:17.768673 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f76b725f-ac10-4103-9f74-9cc311289d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:22:17.770813 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f76b725f-ac10-4103-9f74-9cc311289d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:22:17.773482 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:22:17.774138 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=48 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:22:17.779941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f76b725f-ac10-4103-9f74-9cc311289d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:17.780426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f76b725f-ac10-4103-9f74-9cc311289d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:17.780856 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f76b725f-ac10-4103-9f74-9cc311289d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:17.781550 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f76b725f-ac10-4103-9f74-9cc311289d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:17.782000 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f76b725f-ac10-4103-9f74-9cc311289d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:17.782455 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f76b725f-ac10-4103-9f74-9cc311289d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:17.816350 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f76b725f-ac10-4103-9f74-9cc311289d73 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051545 Aug 10 17:22:17.816815 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 495/1002] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 10 17:22:17 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:22:17.889687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5e6cd4d3-2d23-4e5b-a7d6-8c383fc0b24a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:22:17.891097 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5e6cd4d3-2d23-4e5b-a7d6-8c383fc0b24a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:22:17.893921 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:22:17.894601 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:22:17.899540 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e6cd4d3-2d23-4e5b-a7d6-8c383fc0b24a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:17.902152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e6cd4d3-2d23-4e5b-a7d6-8c383fc0b24a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:17.902152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e6cd4d3-2d23-4e5b-a7d6-8c383fc0b24a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:17.902152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e6cd4d3-2d23-4e5b-a7d6-8c383fc0b24a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:17.902152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e6cd4d3-2d23-4e5b-a7d6-8c383fc0b24a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:17.902598 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e6cd4d3-2d23-4e5b-a7d6-8c383fc0b24a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:17.927296 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5e6cd4d3-2d23-4e5b-a7d6-8c383fc0b24a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:22:18.291505 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5e6cd4d3-2d23-4e5b-a7d6-8c383fc0b24a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 204 len: 0 microversion: 2.20 time: 0.405693 Aug 10 17:22:18.292092 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 508/1003] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 10 17:22:17 2022] DELETE /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 17:22:18.302584 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d1ac8a8c-35aa-4188-8f1e-88d5badcf30b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:22:18.302584 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d1ac8a8c-35aa-4188-8f1e-88d5badcf30b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:22:18.309266 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d1ac8a8c-35aa-4188-8f1e-88d5badcf30b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:18.309931 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d1ac8a8c-35aa-4188-8f1e-88d5badcf30b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:18.310390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d1ac8a8c-35aa-4188-8f1e-88d5badcf30b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:18.311091 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d1ac8a8c-35aa-4188-8f1e-88d5badcf30b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:18.311543 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d1ac8a8c-35aa-4188-8f1e-88d5badcf30b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:18.311965 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d1ac8a8c-35aa-4188-8f1e-88d5badcf30b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:18.450799 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d1ac8a8c-35aa-4188-8f1e-88d5badcf30b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:22:18.459179 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d1ac8a8c-35aa-4188-8f1e-88d5badcf30b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:22:18.460684 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d1ac8a8c-35aa-4188-8f1e-88d5badcf30b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:22:18.461850 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d1ac8a8c-35aa-4188-8f1e-88d5badcf30b tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.164901 Aug 10 17:22:18.463068 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 496/1004] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:22:18 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:22:19.489674 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8c86b003-0dc3-4e51-9cea-4e58e6d1c660 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:22:19.490768 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8c86b003-0dc3-4e51-9cea-4e58e6d1c660 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:22:19.497885 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c86b003-0dc3-4e51-9cea-4e58e6d1c660 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:19.498403 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c86b003-0dc3-4e51-9cea-4e58e6d1c660 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:19.499567 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c86b003-0dc3-4e51-9cea-4e58e6d1c660 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:19.500298 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c86b003-0dc3-4e51-9cea-4e58e6d1c660 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:19.500753 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c86b003-0dc3-4e51-9cea-4e58e6d1c660 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:19.501184 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c86b003-0dc3-4e51-9cea-4e58e6d1c660 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:19.664917 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8c86b003-0dc3-4e51-9cea-4e58e6d1c660 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:22:19.675221 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8c86b003-0dc3-4e51-9cea-4e58e6d1c660 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:22:19.676818 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8c86b003-0dc3-4e51-9cea-4e58e6d1c660 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:22:19.678058 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8c86b003-0dc3-4e51-9cea-4e58e6d1c660 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1722 microversion: 2.20 time: 0.195020 Aug 10 17:22:19.678673 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 509/1005] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:22:19 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:22:20.702665 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d86fead5-8ee5-48b4-8c9f-85f863c5a7ab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:22:20.703211 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d86fead5-8ee5-48b4-8c9f-85f863c5a7ab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:22:20.710708 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d86fead5-8ee5-48b4-8c9f-85f863c5a7ab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:20.711368 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d86fead5-8ee5-48b4-8c9f-85f863c5a7ab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:20.711662 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d86fead5-8ee5-48b4-8c9f-85f863c5a7ab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:20.713973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d86fead5-8ee5-48b4-8c9f-85f863c5a7ab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:20.713973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d86fead5-8ee5-48b4-8c9f-85f863c5a7ab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:20.713973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d86fead5-8ee5-48b4-8c9f-85f863c5a7ab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:20.784050 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d86fead5-8ee5-48b4-8c9f-85f863c5a7ab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:22:20.792710 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d86fead5-8ee5-48b4-8c9f-85f863c5a7ab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:22:20.794270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d86fead5-8ee5-48b4-8c9f-85f863c5a7ab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:22:20.796105 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d86fead5-8ee5-48b4-8c9f-85f863c5a7ab tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1655 microversion: 2.20 time: 0.097062 Aug 10 17:22:20.796962 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 497/1006] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:22:20 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1655 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:22:21.350625 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-f06f3799-3e62-4c09-9346-a4b0465e4e0e req-5385cedb-a066-4479-86a7-2c25ed4b102a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7eaaa8-2f20-4c87-a62a-e855728effb1", "name": "network-vif-deleted", "tag": "d08afacf-c192-4763-9246-60f0a09579d4"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:22:21.362668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f06f3799-3e62-4c09-9346-a4b0465e4e0e req-5385cedb-a066-4479-86a7-2c25ed4b102a service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:21.364273 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f06f3799-3e62-4c09-9346-a4b0465e4e0e req-5385cedb-a066-4479-86a7-2c25ed4b102a service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:21.365549 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f06f3799-3e62-4c09-9346-a4b0465e4e0e req-5385cedb-a066-4479-86a7-2c25ed4b102a service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:21.378904 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-f06f3799-3e62-4c09-9346-a4b0465e4e0e req-5385cedb-a066-4479-86a7-2c25ed4b102a service nova] Creating event network-vif-deleted:d08afacf-c192-4763-9246-60f0a09579d4 for instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 on hv-cinder-85272 Aug 10 17:22:21.384070 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-f06f3799-3e62-4c09-9346-a4b0465e4e0e req-5385cedb-a066-4479-86a7-2c25ed4b102a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037457 Aug 10 17:22:21.384669 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 510/1007] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:22:21.820510 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:22:21.821151 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:22:21.829573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:21.830978 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:21.831626 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:21.832570 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:21.833129 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:21.833642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:21.891986 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:21.892487 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:21.892937 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:21.893398 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lazy-loading 'fault' on Instance uuid 1c7eaaa8-2f20-4c87-a62a-e855728effb1 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:22:21.942966 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:22:21.946621 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:22:21.948530 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf9229cd5d6429ea14249f8976e83cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed45fd312c58480f993616d451abcab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:22:21.950041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-da45729d-efa6-4797-8296-88b9e5d0a26a tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 200 len: 1371 microversion: 2.20 time: 0.133702 Aug 10 17:22:21.951128 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 498/1008] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:22:21 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 1371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 17:22:22.974913 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c3f1a725-7966-44ee-8182-b7a5a59674df tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:22:22.975616 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c3f1a725-7966-44ee-8182-b7a5a59674df tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:22:22.981930 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3f1a725-7966-44ee-8182-b7a5a59674df tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:22.982483 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3f1a725-7966-44ee-8182-b7a5a59674df tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:22.983527 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3f1a725-7966-44ee-8182-b7a5a59674df tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:22.984317 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3f1a725-7966-44ee-8182-b7a5a59674df tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:22.984780 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3f1a725-7966-44ee-8182-b7a5a59674df tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:22.985336 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3f1a725-7966-44ee-8182-b7a5a59674df tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:22.998972 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-c3f1a725-7966-44ee-8182-b7a5a59674df tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] HTTP exception thrown: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c3f1a725-7966-44ee-8182-b7a5a59674df tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Request method failure captured: Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 HTTP/1.1 Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-d5M2Eh7uj9d9Sk4vRzJNVxf4NcKOw3TZvSUj0PkQN9yMJLDBg07ZQZMuHaZf3w1sXyIDQXUhhNenrFSB5Swy3W1uP1Qjpf5eC4n3s1Z2BqiwAxhwByv34rM8TwcBd-GAj5rdcw_CeuHpRyMjHFRi0JrAQ7rA_hbpEpfKZNtzPIBhI Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: ed45fd312c58480f993616d451abcab7 Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:22:23.001003 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:22:23.002855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ed45fd312c58480f993616d451abcab7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ed45fd312c58480f993616d451abcab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ed45fd312c58480f993616d451abcab7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ed45fd312c58480f993616d451abcab7"}]}] Aug 10 17:22:23.002855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:23.002855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: ed45fd312c58480f993616d451abcab7 Aug 10 17:22:23.002855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:23.002855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeShelveTestJSON-916578395-project Aug 10 17:22:23.002855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:22:23.002855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:22:23.002855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 5bf9229cd5d6429ea14249f8976e83cc Aug 10 17:22:23.002855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-916578395-project Aug 10 17:22:23.002855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:22:23.002855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:23.002855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': '1c7eaaa8-2f20-4c87-a62a-e855728effb1'} Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:22:23.003824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:23.005412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:23.007706 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c3f1a725-7966-44ee-8182-b7a5a59674df tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Returning 404 to user: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:22:23.007706 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c3f1a725-7966-44ee-8182-b7a5a59674df tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 404 len: 111 microversion: 2.20 time: 0.032423 Aug 10 17:22:23.007706 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 511/1009] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:22:22 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 17:22:23.012247 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6f797392-4f08-487c-9d55-38d40f35f1f4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '.version_select at 0x7f7eba01bc10>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:22:23.114755 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6f797392-4f08-487c-9d55-38d40f35f1f4 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-350121916" status: 204 len: 0 microversion: 2.20 time: 0.106254 Aug 10 17:22:23.115343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 499/1010] 10.222.0.45 () {60 vars in 1259 bytes} [Wed Aug 10 17:22:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-350121916 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 17:22:25.380106 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1ba6013a-201c-44bc-be7b-045bf49a7eb5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:22:25.380106 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1ba6013a-201c-44bc-be7b-045bf49a7eb5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:22:25.386901 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ba6013a-201c-44bc-be7b-045bf49a7eb5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:25.387394 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ba6013a-201c-44bc-be7b-045bf49a7eb5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:25.387848 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ba6013a-201c-44bc-be7b-045bf49a7eb5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:25.388545 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ba6013a-201c-44bc-be7b-045bf49a7eb5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:25.389010 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ba6013a-201c-44bc-be7b-045bf49a7eb5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:25.389441 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ba6013a-201c-44bc-be7b-045bf49a7eb5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:25.404174 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-1ba6013a-201c-44bc-be7b-045bf49a7eb5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] HTTP exception thrown: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1ba6013a-201c-44bc-be7b-045bf49a7eb5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Request method failure captured: Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 HTTP/1.1 Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-d5M2Eh7uj9d9Sk4vRzJNVxf4NcKOw3TZvSUj0PkQN9yMJLDBg07ZQZMuHaZf3w1sXyIDQXUhhNenrFSB5Swy3W1uP1Qjpf5eC4n3s1Z2BqiwAxhwByv34rM8TwcBd-GAj5rdcw_CeuHpRyMjHFRi0JrAQ7rA_hbpEpfKZNtzPIBhI Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: ed45fd312c58480f993616d451abcab7 Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:22:25.405745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:22:25.407537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ed45fd312c58480f993616d451abcab7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ed45fd312c58480f993616d451abcab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ed45fd312c58480f993616d451abcab7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ed45fd312c58480f993616d451abcab7"}]}] Aug 10 17:22:25.407537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:25.407537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: ed45fd312c58480f993616d451abcab7 Aug 10 17:22:25.407537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:25.407537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeShelveTestJSON-916578395-project Aug 10 17:22:25.407537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:22:25.407537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:22:25.407537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 5bf9229cd5d6429ea14249f8976e83cc Aug 10 17:22:25.407537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-916578395-project Aug 10 17:22:25.407537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:22:25.407537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:25.407537 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': '1c7eaaa8-2f20-4c87-a62a-e855728effb1'} Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:22:25.408548 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:25.410142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:25.411694 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1ba6013a-201c-44bc-be7b-045bf49a7eb5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Returning 404 to user: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:22:25.411694 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1ba6013a-201c-44bc-be7b-045bf49a7eb5 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 404 len: 111 microversion: 2.20 time: 0.032616 Aug 10 17:22:25.411694 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 512/1011] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 10 17:22:25 2022] DELETE /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:22:25.415900 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fb198630-4cf0-41a7-a171-0055f0a92874 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:22:25.416508 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fb198630-4cf0-41a7-a171-0055f0a92874 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1c7eaaa8-2f20-4c87-a62a-e855728effb1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:22:25.424396 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb198630-4cf0-41a7-a171-0055f0a92874 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:25.424521 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb198630-4cf0-41a7-a171-0055f0a92874 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:25.424924 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb198630-4cf0-41a7-a171-0055f0a92874 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:25.425649 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb198630-4cf0-41a7-a171-0055f0a92874 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:25.426145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb198630-4cf0-41a7-a171-0055f0a92874 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:25.426689 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb198630-4cf0-41a7-a171-0055f0a92874 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:25.442765 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-fb198630-4cf0-41a7-a171-0055f0a92874 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] HTTP exception thrown: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fb198630-4cf0-41a7-a171-0055f0a92874 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Request method failure captured: Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 HTTP/1.1 Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-d5M2Eh7uj9d9Sk4vRzJNVxf4NcKOw3TZvSUj0PkQN9yMJLDBg07ZQZMuHaZf3w1sXyIDQXUhhNenrFSB5Swy3W1uP1Qjpf5eC4n3s1Z2BqiwAxhwByv34rM8TwcBd-GAj5rdcw_CeuHpRyMjHFRi0JrAQ7rA_hbpEpfKZNtzPIBhI Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: ed45fd312c58480f993616d451abcab7 Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:22:25.444426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:22:25.446201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ed45fd312c58480f993616d451abcab7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ed45fd312c58480f993616d451abcab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ed45fd312c58480f993616d451abcab7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ed45fd312c58480f993616d451abcab7"}]}] Aug 10 17:22:25.446201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:25.446201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: ed45fd312c58480f993616d451abcab7 Aug 10 17:22:25.446201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:25.446201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeShelveTestJSON-916578395-project Aug 10 17:22:25.446201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:22:25.446201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:22:25.446201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 5bf9229cd5d6429ea14249f8976e83cc Aug 10 17:22:25.446201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeShelveTestJSON-916578395-project Aug 10 17:22:25.446201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:22:25.446201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:25.446201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': '1c7eaaa8-2f20-4c87-a62a-e855728effb1'} Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:22:25.447415 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. Aug 10 17:22:25.449232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:22:25.450837 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fb198630-4cf0-41a7-a171-0055f0a92874 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Returning 404 to user: Instance 1c7eaaa8-2f20-4c87-a62a-e855728effb1 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:22:25.450837 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fb198630-4cf0-41a7-a171-0055f0a92874 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1" status: 404 len: 111 microversion: 2.20 time: 0.033790 Aug 10 17:22:25.450837 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 500/1012] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:22:25 2022] GET /compute/v2.1/servers/1c7eaaa8-2f20-4c87-a62a-e855728effb1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:22:26.788795 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-31ebbd8b-dca8-45e4-9d92-a22f30b2ebfb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:22:26.789302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-31ebbd8b-dca8-45e4-9d92-a22f30b2ebfb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:22:26.795774 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31ebbd8b-dca8-45e4-9d92-a22f30b2ebfb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:26.796271 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31ebbd8b-dca8-45e4-9d92-a22f30b2ebfb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:26.796713 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31ebbd8b-dca8-45e4-9d92-a22f30b2ebfb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:26.797447 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31ebbd8b-dca8-45e4-9d92-a22f30b2ebfb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:26.797905 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31ebbd8b-dca8-45e4-9d92-a22f30b2ebfb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:26.798338 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31ebbd8b-dca8-45e4-9d92-a22f30b2ebfb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:26.811865 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-31ebbd8b-dca8-45e4-9d92-a22f30b2ebfb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] HTTP exception thrown: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-31ebbd8b-dca8-45e4-9d92-a22f30b2ebfb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Request method failure captured: Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 HTTP/1.1 Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-d5M2Eh7uj9d9Sk4vRzJNVxf4NcKOw3TZvSUj0PkQN9yMJLDBg07ZQZMuHaZf3w1sXyIDQXUhhNenrFSB5Swy3W1uP1Qjpf5eC4n3s1Z2BqiwAxhwByv34rM8TwcBd-GAj5rdcw_CeuHpRyMjHFRi0JrAQ7rA_hbpEpfKZNtzPIBhI Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: ed45fd312c58480f993616d451abcab7 Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:22:26.814824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:22:26.816476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ed45fd312c58480f993616d451abcab7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ed45fd312c58480f993616d451abcab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ed45fd312c58480f993616d451abcab7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ed45fd312c58480f993616d451abcab7"}]}] Aug 10 17:22:26.816476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:26.816476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: ed45fd312c58480f993616d451abcab7 Aug 10 17:22:26.816476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:26.816476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeShelveTestJSON-916578395-project Aug 10 17:22:26.816476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:22:26.816476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:22:26.816476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: 5bf9229cd5d6429ea14249f8976e83cc Aug 10 17:22:26.816476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-916578395-project Aug 10 17:22:26.816476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:22:26.816476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:22:26.816476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': '1e46673f-6139-4b97-b57a-b65886eb16b1'} Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:22:26.817355 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:22:26.818995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:22:26.820617 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-31ebbd8b-dca8-45e4-9d92-a22f30b2ebfb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Returning 404 to user: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:22:26.820617 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-31ebbd8b-dca8-45e4-9d92-a22f30b2ebfb tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 404 len: 111 microversion: 2.20 time: 0.030611 Aug 10 17:22:26.820617 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 513/1013] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 10 17:22:26 2022] DELETE /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:22:26.824209 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-23820380-0128-4534-bdfb-d8b605dc3f52 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:22:26.824852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-23820380-0128-4534-bdfb-d8b605dc3f52 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] [instance: 1e46673f-6139-4b97-b57a-b65886eb16b1] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:22:26.832090 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23820380-0128-4534-bdfb-d8b605dc3f52 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:26.832480 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23820380-0128-4534-bdfb-d8b605dc3f52 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:26.832922 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23820380-0128-4534-bdfb-d8b605dc3f52 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:26.833621 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23820380-0128-4534-bdfb-d8b605dc3f52 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:22:26.834085 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23820380-0128-4534-bdfb-d8b605dc3f52 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:22:26.834548 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23820380-0128-4534-bdfb-d8b605dc3f52 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:22:26.848489 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-23820380-0128-4534-bdfb-d8b605dc3f52 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] HTTP exception thrown: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-23820380-0128-4534-bdfb-d8b605dc3f52 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Request method failure captured: Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 HTTP/1.1 Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-d5M2Eh7uj9d9Sk4vRzJNVxf4NcKOw3TZvSUj0PkQN9yMJLDBg07ZQZMuHaZf3w1sXyIDQXUhhNenrFSB5Swy3W1uP1Qjpf5eC4n3s1Z2BqiwAxhwByv34rM8TwcBd-GAj5rdcw_CeuHpRyMjHFRi0JrAQ7rA_hbpEpfKZNtzPIBhI Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: ed45fd312c58480f993616d451abcab7 Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:22:26.850081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:22:26.851782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ed45fd312c58480f993616d451abcab7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ed45fd312c58480f993616d451abcab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ed45fd312c58480f993616d451abcab7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ed45fd312c58480f993616d451abcab7"}]}] Aug 10 17:22:26.851782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:26.851782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: ed45fd312c58480f993616d451abcab7 Aug 10 17:22:26.851782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-916578395 Aug 10 17:22:26.851782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeShelveTestJSON-916578395-project Aug 10 17:22:26.851782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:22:26.851782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:22:26.851782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 5bf9229cd5d6429ea14249f8976e83cc Aug 10 17:22:26.851782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeShelveTestJSON-916578395-project Aug 10 17:22:26.851782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:22:26.851782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:22:26.851782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': '1e46673f-6139-4b97-b57a-b65886eb16b1'} Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:22:26.852531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. Aug 10 17:22:26.854949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:22:26.856103 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-23820380-0128-4534-bdfb-d8b605dc3f52 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] Returning 404 to user: Instance 1e46673f-6139-4b97-b57a-b65886eb16b1 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:22:26.856103 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-23820380-0128-4534-bdfb-d8b605dc3f52 tempest-AttachVolumeShelveTestJSON-916578395 tempest-AttachVolumeShelveTestJSON-916578395-project] 10.222.0.45 "GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1" status: 404 len: 111 microversion: 2.20 time: 0.031245 Aug 10 17:22:26.856103 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 501/1014] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 17:22:26 2022] GET /compute/v2.1/servers/1e46673f-6139-4b97-b57a-b65886eb16b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 17:22:45.251480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:22:45.251990 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Wed Aug 10 17:22:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:22:51.883974 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:22:51.884667 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Wed Aug 10 17:22:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:23:05.484985 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2020508742", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "networks": [{"uuid": "8d021d76-7ee6-4e91-9684-951a3c45eb44"}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:23:05.494860 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:23:05.495511 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:23:05.542308 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] validate_networks() for [('8d021d76-7ee6-4e91-9684-951a3c45eb44', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:23:05.915130 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:23:05.915687 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:23:05.916166 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:23:05.916546 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:23:05.916961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:23:05.929122 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:05.929122 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:05.929122 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:05.929122 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:05.929557 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:05.929557 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:05.952187 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Getting quotas for project a49a6fc2c18d44b8a8b82307021355fd. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:23:05.956625 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Getting quotas for user 0d7d26ea8e26466f91b1905aa1e2e156 and project a49a6fc2c18d44b8a8b82307021355fd. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:23:05.977826 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:23:05.980266 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:23:06.133225 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1e35c610-7d29-4b9f-8ab3-a6259278fa4e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652175 Aug 10 17:23:06.140000 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 514/1015] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:23:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:23:06.145579 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-217e5af3-0e1d-4f77-99c7-634aaa59999e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:06.146258 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-217e5af3-0e1d-4f77-99c7-634aaa59999e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:06.148326 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:23:06.149250 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=30 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:23:06.203193 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-217e5af3-0e1d-4f77-99c7-634aaa59999e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:06.211782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-217e5af3-0e1d-4f77-99c7-634aaa59999e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1219 microversion: 2.1 time: 0.070485 Aug 10 17:23:06.225112 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 502/1016] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:06 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:23:07.234663 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d93141bd-5cdf-43ac-a94e-559c798fe6b9 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:07.235753 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d93141bd-5cdf-43ac-a94e-559c798fe6b9 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:07.298976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d93141bd-5cdf-43ac-a94e-559c798fe6b9 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:07.306241 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d93141bd-5cdf-43ac-a94e-559c798fe6b9 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1219 microversion: 2.1 time: 0.076726 Aug 10 17:23:07.306832 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 515/1017] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:07 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:23:08.328828 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-19add93f-1055-4e48-99b2-a990280160ed tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:08.328828 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-19add93f-1055-4e48-99b2-a990280160ed tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:08.336806 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-19add93f-1055-4e48-99b2-a990280160ed tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:08.337423 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-19add93f-1055-4e48-99b2-a990280160ed tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:08.337868 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-19add93f-1055-4e48-99b2-a990280160ed tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:08.338723 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-19add93f-1055-4e48-99b2-a990280160ed tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:08.339177 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-19add93f-1055-4e48-99b2-a990280160ed tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:08.339781 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-19add93f-1055-4e48-99b2-a990280160ed tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:08.404665 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-19add93f-1055-4e48-99b2-a990280160ed tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:08.412133 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-19add93f-1055-4e48-99b2-a990280160ed tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1215 microversion: 2.1 time: 0.088460 Aug 10 17:23:08.412700 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 503/1018] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:08 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:23:09.437380 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ca4f80cd-d5d8-4da7-950d-156ca78a038a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:09.439514 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ca4f80cd-d5d8-4da7-950d-156ca78a038a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:09.448924 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca4f80cd-d5d8-4da7-950d-156ca78a038a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:09.452776 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca4f80cd-d5d8-4da7-950d-156ca78a038a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:09.452776 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca4f80cd-d5d8-4da7-950d-156ca78a038a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:09.452776 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca4f80cd-d5d8-4da7-950d-156ca78a038a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:09.453929 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca4f80cd-d5d8-4da7-950d-156ca78a038a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:09.454407 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ca4f80cd-d5d8-4da7-950d-156ca78a038a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:09.537019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ca4f80cd-d5d8-4da7-950d-156ca78a038a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:09.544871 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ca4f80cd-d5d8-4da7-950d-156ca78a038a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1279 microversion: 2.1 time: 0.115613 Aug 10 17:23:09.547057 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 516/1019] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:09 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1279 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:23:10.569360 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5db834b0-70fa-43c5-b9e7-227503d12ecd tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:10.570032 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5db834b0-70fa-43c5-b9e7-227503d12ecd tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:10.589117 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5db834b0-70fa-43c5-b9e7-227503d12ecd tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:10.590100 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5db834b0-70fa-43c5-b9e7-227503d12ecd tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:10.590585 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5db834b0-70fa-43c5-b9e7-227503d12ecd tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:10.591319 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5db834b0-70fa-43c5-b9e7-227503d12ecd tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:10.591801 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5db834b0-70fa-43c5-b9e7-227503d12ecd tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:10.592213 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5db834b0-70fa-43c5-b9e7-227503d12ecd tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:10.752166 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5db834b0-70fa-43c5-b9e7-227503d12ecd tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:10.760319 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5db834b0-70fa-43c5-b9e7-227503d12ecd tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1319 microversion: 2.1 time: 0.195445 Aug 10 17:23:10.760877 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 504/1020] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:10 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:23:11.114636 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-93b607ab-89f5-447c-9bda-6db549cc7f6f req-1ad51ec5-77dd-4445-8085-1ec2addec8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "331b2dee-c26f-453d-9790-4e55f5e8e7c3", "tag": "00331a72-0b63-4771-a1e3-9b24b55ec47b"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:23:11.127365 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-93b607ab-89f5-447c-9bda-6db549cc7f6f req-1ad51ec5-77dd-4445-8085-1ec2addec8f7 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:11.133478 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-93b607ab-89f5-447c-9bda-6db549cc7f6f req-1ad51ec5-77dd-4445-8085-1ec2addec8f7 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:11.133478 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-93b607ab-89f5-447c-9bda-6db549cc7f6f req-1ad51ec5-77dd-4445-8085-1ec2addec8f7 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:11.141766 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-93b607ab-89f5-447c-9bda-6db549cc7f6f req-1ad51ec5-77dd-4445-8085-1ec2addec8f7 service nova] Creating event network-changed:00331a72-0b63-4771-a1e3-9b24b55ec47b for instance 331b2dee-c26f-453d-9790-4e55f5e8e7c3 on hv-cinder-85272 Aug 10 17:23:11.148257 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-93b607ab-89f5-447c-9bda-6db549cc7f6f req-1ad51ec5-77dd-4445-8085-1ec2addec8f7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038915 Aug 10 17:23:11.148774 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 517/1021] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:23:11.781298 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1a133200-152d-42df-aa73-f34433356f04 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:11.781904 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1a133200-152d-42df-aa73-f34433356f04 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:11.788458 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a133200-152d-42df-aa73-f34433356f04 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:11.788942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a133200-152d-42df-aa73-f34433356f04 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:11.789414 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a133200-152d-42df-aa73-f34433356f04 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:11.790176 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a133200-152d-42df-aa73-f34433356f04 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:11.790655 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a133200-152d-42df-aa73-f34433356f04 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:11.791078 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a133200-152d-42df-aa73-f34433356f04 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:11.945525 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1a133200-152d-42df-aa73-f34433356f04 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:11.953660 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1a133200-152d-42df-aa73-f34433356f04 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1319 microversion: 2.1 time: 0.176746 Aug 10 17:23:11.954229 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 505/1022] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:11 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:23:12.975230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-307fc15b-b960-42fa-9319-aa28139b421a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:12.975829 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-307fc15b-b960-42fa-9319-aa28139b421a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:12.982555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-307fc15b-b960-42fa-9319-aa28139b421a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:12.983038 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-307fc15b-b960-42fa-9319-aa28139b421a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:12.983469 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-307fc15b-b960-42fa-9319-aa28139b421a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:12.984727 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-307fc15b-b960-42fa-9319-aa28139b421a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:12.985182 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-307fc15b-b960-42fa-9319-aa28139b421a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:12.985601 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-307fc15b-b960-42fa-9319-aa28139b421a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:13.153535 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-307fc15b-b960-42fa-9319-aa28139b421a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:13.166250 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-307fc15b-b960-42fa-9319-aa28139b421a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1319 microversion: 2.1 time: 0.192726 Aug 10 17:23:13.166250 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 518/1023] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:12 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:23:14.186010 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8d22de4a-7e12-425e-81e3-d373515b1d79 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:14.186659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8d22de4a-7e12-425e-81e3-d373515b1d79 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:14.194031 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d22de4a-7e12-425e-81e3-d373515b1d79 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:14.194571 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d22de4a-7e12-425e-81e3-d373515b1d79 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:14.195014 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d22de4a-7e12-425e-81e3-d373515b1d79 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:14.195716 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d22de4a-7e12-425e-81e3-d373515b1d79 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:14.196174 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d22de4a-7e12-425e-81e3-d373515b1d79 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:14.196751 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d22de4a-7e12-425e-81e3-d373515b1d79 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:14.395701 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8d22de4a-7e12-425e-81e3-d373515b1d79 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:14.404116 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8d22de4a-7e12-425e-81e3-d373515b1d79 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1319 microversion: 2.1 time: 0.221941 Aug 10 17:23:14.404669 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 506/1024] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:14 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:23:15.425759 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8f2d0dc3-50b7-4622-8fb0-e9589e985402 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:15.426659 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8f2d0dc3-50b7-4622-8fb0-e9589e985402 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:15.433412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f2d0dc3-50b7-4622-8fb0-e9589e985402 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:15.434045 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f2d0dc3-50b7-4622-8fb0-e9589e985402 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:15.434521 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f2d0dc3-50b7-4622-8fb0-e9589e985402 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:15.435230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f2d0dc3-50b7-4622-8fb0-e9589e985402 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:15.435716 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f2d0dc3-50b7-4622-8fb0-e9589e985402 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:15.436260 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f2d0dc3-50b7-4622-8fb0-e9589e985402 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:15.584451 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8f2d0dc3-50b7-4622-8fb0-e9589e985402 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:15.591923 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8f2d0dc3-50b7-4622-8fb0-e9589e985402 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1319 microversion: 2.1 time: 0.170639 Aug 10 17:23:15.592476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 519/1025] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:15 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:23:16.613866 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-53d47022-7584-4a54-988a-aec49f627903 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:16.614555 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-53d47022-7584-4a54-988a-aec49f627903 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:16.617068 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:23:16.621940 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53d47022-7584-4a54-988a-aec49f627903 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:16.622473 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53d47022-7584-4a54-988a-aec49f627903 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:16.622914 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53d47022-7584-4a54-988a-aec49f627903 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:16.623616 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53d47022-7584-4a54-988a-aec49f627903 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:16.624180 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53d47022-7584-4a54-988a-aec49f627903 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:16.624609 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-53d47022-7584-4a54-988a-aec49f627903 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:16.778232 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-ab19774b-8226-41ce-a956-09e4a20c05b8 req-7851933d-e4b3-4f90-ac56-93027e3bfc70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331b2dee-c26f-453d-9790-4e55f5e8e7c3", "name": "network-vif-plugged", "status": "completed", "tag": "00331a72-0b63-4771-a1e3-9b24b55ec47b"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:23:16.786860 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:23:16.789345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ab19774b-8226-41ce-a956-09e4a20c05b8 req-7851933d-e4b3-4f90-ac56-93027e3bfc70 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:16.790240 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ab19774b-8226-41ce-a956-09e4a20c05b8 req-7851933d-e4b3-4f90-ac56-93027e3bfc70 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:16.790869 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ab19774b-8226-41ce-a956-09e4a20c05b8 req-7851933d-e4b3-4f90-ac56-93027e3bfc70 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:16.793754 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-53d47022-7584-4a54-988a-aec49f627903 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:16.803108 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-ab19774b-8226-41ce-a956-09e4a20c05b8 req-7851933d-e4b3-4f90-ac56-93027e3bfc70 service nova] Creating event network-vif-plugged:00331a72-0b63-4771-a1e3-9b24b55ec47b for instance 331b2dee-c26f-453d-9790-4e55f5e8e7c3 on hv-cinder-85272 Aug 10 17:23:16.807684 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-53d47022-7584-4a54-988a-aec49f627903 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1319 microversion: 2.1 time: 0.194762 Aug 10 17:23:16.807684 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 507/1026] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:16 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:23:16.820212 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-ab19774b-8226-41ce-a956-09e4a20c05b8 req-7851933d-e4b3-4f90-ac56-93027e3bfc70 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045267 Aug 10 17:23:16.820837 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 520/1027] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:23:17.824632 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0a42a81b-5549-4b40-a720-48ea0c6f0808 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:17.825182 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0a42a81b-5549-4b40-a720-48ea0c6f0808 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:17.832325 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a42a81b-5549-4b40-a720-48ea0c6f0808 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:17.832806 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a42a81b-5549-4b40-a720-48ea0c6f0808 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:17.833239 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a42a81b-5549-4b40-a720-48ea0c6f0808 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:17.833923 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a42a81b-5549-4b40-a720-48ea0c6f0808 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:17.834390 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a42a81b-5549-4b40-a720-48ea0c6f0808 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:17.834812 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0a42a81b-5549-4b40-a720-48ea0c6f0808 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:17.974985 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0a42a81b-5549-4b40-a720-48ea0c6f0808 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:17.982458 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0a42a81b-5549-4b40-a720-48ea0c6f0808 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1319 microversion: 2.1 time: 0.161878 Aug 10 17:23:17.983081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 508/1028] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:17 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:23:19.001580 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=8 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:23:19.007798 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-31bcc4e0-1759-4830-9860-261aa9fe0e4c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:19.011983 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-31bcc4e0-1759-4830-9860-261aa9fe0e4c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:19.014961 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31bcc4e0-1759-4830-9860-261aa9fe0e4c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:19.015445 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31bcc4e0-1759-4830-9860-261aa9fe0e4c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:19.015877 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31bcc4e0-1759-4830-9860-261aa9fe0e4c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:19.016567 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31bcc4e0-1759-4830-9860-261aa9fe0e4c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:19.017014 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31bcc4e0-1759-4830-9860-261aa9fe0e4c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:19.017434 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31bcc4e0-1759-4830-9860-261aa9fe0e4c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:19.151957 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-31bcc4e0-1759-4830-9860-261aa9fe0e4c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:19.159588 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-31bcc4e0-1759-4830-9860-261aa9fe0e4c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1319 microversion: 2.1 time: 0.159042 Aug 10 17:23:19.160826 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 521/1029] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:18 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:23:20.179680 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ac7a1073-b1a5-413a-b8d7-5bb971dca20b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:20.180229 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ac7a1073-b1a5-413a-b8d7-5bb971dca20b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:20.186623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac7a1073-b1a5-413a-b8d7-5bb971dca20b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:20.187114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac7a1073-b1a5-413a-b8d7-5bb971dca20b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:20.187559 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac7a1073-b1a5-413a-b8d7-5bb971dca20b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:20.188253 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac7a1073-b1a5-413a-b8d7-5bb971dca20b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:20.188733 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac7a1073-b1a5-413a-b8d7-5bb971dca20b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:20.189160 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac7a1073-b1a5-413a-b8d7-5bb971dca20b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:20.326597 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ac7a1073-b1a5-413a-b8d7-5bb971dca20b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:20.335020 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ac7a1073-b1a5-413a-b8d7-5bb971dca20b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1508 microversion: 2.1 time: 0.159288 Aug 10 17:23:20.335589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 509/1030] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:20 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:23:41.425987 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ea5f3198-3824-4728-bf58-67f2f60853d3 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d628473-24be-4ca9-a263-005d48b4482a", "device": "/dev/sdb"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:23:41.429691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ea5f3198-3824-4728-bf58-67f2f60853d3 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:41.437030 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:23:41.438099 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=30 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:23:41.440402 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea5f3198-3824-4728-bf58-67f2f60853d3 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:41.441979 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea5f3198-3824-4728-bf58-67f2f60853d3 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:41.442678 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea5f3198-3824-4728-bf58-67f2f60853d3 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:41.443763 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea5f3198-3824-4728-bf58-67f2f60853d3 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:41.445104 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea5f3198-3824-4728-bf58-67f2f60853d3 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:41.445717 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea5f3198-3824-4728-bf58-67f2f60853d3 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:42.482095 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ea5f3198-3824-4728-bf58-67f2f60853d3 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "POST /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.061172 Aug 10 17:23:42.484043 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 522/1031] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 17:23:41 2022] POST /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3/os-volume_attachments => generated 194 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:23:56.011231 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f2c390cf-1a29-4d05-b15e-d81b16dd267c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Action: 'create', calling method: .version_select at 0x7f7eba07cc10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1469596934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWxypHHbo1aBCTCzcUbAVfbIx8tVAZHTSbUrXlF3wh5JUszPb5OW8tt6jvRy4j4srSA1b4M6lMtInhXAZZmezy07sEjY02byIg8WfUQ12nXLi8IuBBygK5PFkvcCzfL6w=="}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:23:56.016932 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=18 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:23:56.018907 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=42 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:23:56.028707 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-f2c390cf-1a29-4d05-b15e-d81b16dd267c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Getting quotas for project 0ca8a0c2eb86470cb9e609f05e4ceee7. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:23:56.032744 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-f2c390cf-1a29-4d05-b15e-d81b16dd267c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Getting quotas for user dd1ac5036e16409a9a5cac62fed7d7e7 and project 0ca8a0c2eb86470cb9e609f05e4ceee7. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:23:56.147569 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f2c390cf-1a29-4d05-b15e-d81b16dd267c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.140053 Aug 10 17:23:56.150802 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 510/1032] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 17:23:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:23:56.244852 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:23:56.245561 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:23:56.249660 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2107676676", "imageRef": "871de768-7a1d-4118-93ec-3e363d64bd6b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1469596934", "networks": [{"uuid": "df4f3f1b-9115-4194-a561-2cc415a27268"}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:23:56.302124 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] validate_networks() for [('df4f3f1b-9115-4194-a561-2cc415a27268', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:23:56.916744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:23:56.917182 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:23:56.917706 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:23:56.918124 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:23:56.918567 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:23:56.927481 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:56.927966 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:56.928405 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:56.929137 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:23:56.929593 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:23:56.930024 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:23:56.947252 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Getting quotas for project 0ca8a0c2eb86470cb9e609f05e4ceee7. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:23:56.951296 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Getting quotas for user dd1ac5036e16409a9a5cac62fed7d7e7 and project 0ca8a0c2eb86470cb9e609f05e4ceee7. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:23:56.962944 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:23:56.965221 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='871de768-7a1d-4118-93ec-3e363d64bd6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:23:57.142600 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f5b20183-b347-4249-a172-27dc412972b8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899098 Aug 10 17:23:57.143929 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 523/1033] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:23:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:23:57.155554 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4afdd5b8-78ba-4dc0-add8-af2327a97a47 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:57.156201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4afdd5b8-78ba-4dc0-add8-af2327a97a47 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:57.208811 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4afdd5b8-78ba-4dc0-add8-af2327a97a47 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:57.216810 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4afdd5b8-78ba-4dc0-add8-af2327a97a47 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1259 microversion: 2.1 time: 0.066024 Aug 10 17:23:57.217392 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 511/1034] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:57 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1259 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:23:58.239048 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4d7bc74b-439d-4e21-aec7-17b5cf4680e0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:58.245883 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4d7bc74b-439d-4e21-aec7-17b5cf4680e0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:58.294223 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4d7bc74b-439d-4e21-aec7-17b5cf4680e0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:58.301608 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4d7bc74b-439d-4e21-aec7-17b5cf4680e0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1259 microversion: 2.1 time: 0.068079 Aug 10 17:23:58.302184 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 524/1035] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:58 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:23:59.322626 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-181d8ca0-62c8-43ac-92d3-cd50ba39a615 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:23:59.323547 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-181d8ca0-62c8-43ac-92d3-cd50ba39a615 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:23:59.382244 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-181d8ca0-62c8-43ac-92d3-cd50ba39a615 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:23:59.389336 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-181d8ca0-62c8-43ac-92d3-cd50ba39a615 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1259 microversion: 2.1 time: 0.070755 Aug 10 17:23:59.393770 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 512/1036] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:23:59 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:00.410192 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7e05087d-caf2-4939-890c-e69a62bddaec tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:00.410814 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7e05087d-caf2-4939-890c-e69a62bddaec tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:00.463555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7e05087d-caf2-4939-890c-e69a62bddaec tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:00.470194 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7e05087d-caf2-4939-890c-e69a62bddaec tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1259 microversion: 2.1 time: 0.063854 Aug 10 17:24:00.470802 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 525/1037] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:00 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1259 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:01.490717 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f7668f42-76cb-4e3c-92ff-3d8f88d9edef tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:01.491348 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f7668f42-76cb-4e3c-92ff-3d8f88d9edef tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:01.497752 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f7668f42-76cb-4e3c-92ff-3d8f88d9edef tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:01.498232 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f7668f42-76cb-4e3c-92ff-3d8f88d9edef tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:01.498692 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f7668f42-76cb-4e3c-92ff-3d8f88d9edef tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:01.499396 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f7668f42-76cb-4e3c-92ff-3d8f88d9edef tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:01.499824 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f7668f42-76cb-4e3c-92ff-3d8f88d9edef tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:01.500241 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f7668f42-76cb-4e3c-92ff-3d8f88d9edef tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:01.560337 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f7668f42-76cb-4e3c-92ff-3d8f88d9edef tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:01.568170 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f7668f42-76cb-4e3c-92ff-3d8f88d9edef tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1263 microversion: 2.1 time: 0.080881 Aug 10 17:24:01.568734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 513/1038] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:01 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:02.588826 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d65e4762-6f8e-4050-9eb1-cb30e7fa40f7 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:02.589449 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d65e4762-6f8e-4050-9eb1-cb30e7fa40f7 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:02.597085 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d65e4762-6f8e-4050-9eb1-cb30e7fa40f7 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:02.602065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d65e4762-6f8e-4050-9eb1-cb30e7fa40f7 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:02.602065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d65e4762-6f8e-4050-9eb1-cb30e7fa40f7 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:02.602065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d65e4762-6f8e-4050-9eb1-cb30e7fa40f7 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:02.602065 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d65e4762-6f8e-4050-9eb1-cb30e7fa40f7 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:02.602474 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d65e4762-6f8e-4050-9eb1-cb30e7fa40f7 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:02.663656 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d65e4762-6f8e-4050-9eb1-cb30e7fa40f7 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:02.671264 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d65e4762-6f8e-4050-9eb1-cb30e7fa40f7 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1263 microversion: 2.1 time: 0.086416 Aug 10 17:24:02.671819 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 526/1039] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:02 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1263 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:03.692742 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fcab8c0c-bda6-498a-91a5-3d830e0fdcf1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:03.693350 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fcab8c0c-bda6-498a-91a5-3d830e0fdcf1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:03.699731 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fcab8c0c-bda6-498a-91a5-3d830e0fdcf1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:03.700212 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fcab8c0c-bda6-498a-91a5-3d830e0fdcf1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:03.700644 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fcab8c0c-bda6-498a-91a5-3d830e0fdcf1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:03.701329 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fcab8c0c-bda6-498a-91a5-3d830e0fdcf1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:03.701776 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fcab8c0c-bda6-498a-91a5-3d830e0fdcf1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:03.702192 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fcab8c0c-bda6-498a-91a5-3d830e0fdcf1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:03.767533 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fcab8c0c-bda6-498a-91a5-3d830e0fdcf1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:03.775659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fcab8c0c-bda6-498a-91a5-3d830e0fdcf1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1319 microversion: 2.1 time: 0.086493 Aug 10 17:24:03.775957 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 514/1040] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:03 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1319 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:04.798471 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fe1b5f3d-8864-4851-add8-4481ba799f08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:04.799083 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fe1b5f3d-8864-4851-add8-4481ba799f08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:04.805754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe1b5f3d-8864-4851-add8-4481ba799f08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:04.806269 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe1b5f3d-8864-4851-add8-4481ba799f08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:04.806736 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe1b5f3d-8864-4851-add8-4481ba799f08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:04.807603 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe1b5f3d-8864-4851-add8-4481ba799f08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:04.808054 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe1b5f3d-8864-4851-add8-4481ba799f08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:04.808477 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe1b5f3d-8864-4851-add8-4481ba799f08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:05.177897 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fe1b5f3d-8864-4851-add8-4481ba799f08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:05.185921 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fe1b5f3d-8864-4851-add8-4481ba799f08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1319 microversion: 2.1 time: 0.391397 Aug 10 17:24:05.186746 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 527/1041] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:04 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:06.207564 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4115b963-9f32-4480-a192-7c691e10ab01 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:06.208181 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4115b963-9f32-4480-a192-7c691e10ab01 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:06.215617 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4115b963-9f32-4480-a192-7c691e10ab01 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:06.216113 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4115b963-9f32-4480-a192-7c691e10ab01 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:06.216555 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4115b963-9f32-4480-a192-7c691e10ab01 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:06.217251 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4115b963-9f32-4480-a192-7c691e10ab01 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:06.217835 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4115b963-9f32-4480-a192-7c691e10ab01 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:06.218263 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4115b963-9f32-4480-a192-7c691e10ab01 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:06.359091 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4115b963-9f32-4480-a192-7c691e10ab01 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:06.367238 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4115b963-9f32-4480-a192-7c691e10ab01 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1329 microversion: 2.1 time: 0.163568 Aug 10 17:24:06.367806 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 515/1042] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:06 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1329 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:07.388731 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6115cd6b-a3d8-49d9-bb65-a9b078bbb934 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:07.389345 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6115cd6b-a3d8-49d9-bb65-a9b078bbb934 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:07.392204 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:24:07.401455 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6115cd6b-a3d8-49d9-bb65-a9b078bbb934 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:07.402206 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6115cd6b-a3d8-49d9-bb65-a9b078bbb934 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:07.403185 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6115cd6b-a3d8-49d9-bb65-a9b078bbb934 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:07.406041 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6115cd6b-a3d8-49d9-bb65-a9b078bbb934 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:07.406041 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6115cd6b-a3d8-49d9-bb65-a9b078bbb934 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:07.406041 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6115cd6b-a3d8-49d9-bb65-a9b078bbb934 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:07.562923 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6115cd6b-a3d8-49d9-bb65-a9b078bbb934 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:07.573797 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6115cd6b-a3d8-49d9-bb65-a9b078bbb934 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.188862 Aug 10 17:24:07.575205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 528/1043] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:07 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:08.596913 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2ca85b79-5266-4ae6-b7e9-6ac0cefc9e21 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:08.598154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2ca85b79-5266-4ae6-b7e9-6ac0cefc9e21 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:08.611359 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ca85b79-5266-4ae6-b7e9-6ac0cefc9e21 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:08.611882 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ca85b79-5266-4ae6-b7e9-6ac0cefc9e21 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:08.612348 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ca85b79-5266-4ae6-b7e9-6ac0cefc9e21 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:08.613304 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ca85b79-5266-4ae6-b7e9-6ac0cefc9e21 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:08.614825 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ca85b79-5266-4ae6-b7e9-6ac0cefc9e21 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:08.623841 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ca85b79-5266-4ae6-b7e9-6ac0cefc9e21 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:08.781803 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2ca85b79-5266-4ae6-b7e9-6ac0cefc9e21 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:08.793576 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2ca85b79-5266-4ae6-b7e9-6ac0cefc9e21 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.201997 Aug 10 17:24:08.802468 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 516/1044] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:08 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:09.816259 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fcaf3ab0-f42d-42d4-b718-d88b4a706e0c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:09.816898 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fcaf3ab0-f42d-42d4-b718-d88b4a706e0c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:09.824309 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcaf3ab0-f42d-42d4-b718-d88b4a706e0c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:09.824802 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcaf3ab0-f42d-42d4-b718-d88b4a706e0c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:09.825245 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcaf3ab0-f42d-42d4-b718-d88b4a706e0c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:09.825958 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcaf3ab0-f42d-42d4-b718-d88b4a706e0c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:09.826637 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcaf3ab0-f42d-42d4-b718-d88b4a706e0c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:09.827077 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fcaf3ab0-f42d-42d4-b718-d88b4a706e0c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:09.984197 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fcaf3ab0-f42d-42d4-b718-d88b4a706e0c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:09.992034 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fcaf3ab0-f42d-42d4-b718-d88b4a706e0c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.179702 Aug 10 17:24:09.992603 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 529/1045] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:09 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:10.951584 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cb368a1a-3215-433b-93d1-77aa92ee8b09 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:10.952097 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cb368a1a-3215-433b-93d1-77aa92ee8b09 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:10.953895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=8 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:24:10.959423 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb368a1a-3215-433b-93d1-77aa92ee8b09 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:10.959913 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb368a1a-3215-433b-93d1-77aa92ee8b09 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:10.960410 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb368a1a-3215-433b-93d1-77aa92ee8b09 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:10.961114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb368a1a-3215-433b-93d1-77aa92ee8b09 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:10.961565 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb368a1a-3215-433b-93d1-77aa92ee8b09 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:10.961985 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb368a1a-3215-433b-93d1-77aa92ee8b09 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:11.016192 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-09cfdc59-7113-4629-a939-95de2ea9a047 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:11.016789 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-09cfdc59-7113-4629-a939-95de2ea9a047 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:11.018760 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=10 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:24:11.030993 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-09cfdc59-7113-4629-a939-95de2ea9a047 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:11.031480 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-09cfdc59-7113-4629-a939-95de2ea9a047 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:11.032113 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-09cfdc59-7113-4629-a939-95de2ea9a047 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:11.032824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-09cfdc59-7113-4629-a939-95de2ea9a047 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:11.033277 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-09cfdc59-7113-4629-a939-95de2ea9a047 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:11.033697 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-09cfdc59-7113-4629-a939-95de2ea9a047 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:11.077994 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-cb368a1a-3215-433b-93d1-77aa92ee8b09 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lazy-loading 'services' on Instance uuid 331b2dee-c26f-453d-9790-4e55f5e8e7c3 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:24:11.189956 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-09cfdc59-7113-4629-a939-95de2ea9a047 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:11.197960 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-09cfdc59-7113-4629-a939-95de2ea9a047 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.185600 Aug 10 17:24:11.199657 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 530/1046] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:11 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:11.366589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cb368a1a-3215-433b-93d1-77aa92ee8b09 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [981ac677-9bc6-4895-8b89-4fe372b419d8] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 17:24:12.220375 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-90bbc4e0-210a-4a9a-9ca4-e4fd7ec6e7ce tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:12.220984 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-90bbc4e0-210a-4a9a-9ca4-e4fd7ec6e7ce tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:12.227459 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90bbc4e0-210a-4a9a-9ca4-e4fd7ec6e7ce tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:12.229095 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90bbc4e0-210a-4a9a-9ca4-e4fd7ec6e7ce tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:12.229095 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90bbc4e0-210a-4a9a-9ca4-e4fd7ec6e7ce tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:12.229095 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90bbc4e0-210a-4a9a-9ca4-e4fd7ec6e7ce tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:12.229531 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90bbc4e0-210a-4a9a-9ca4-e4fd7ec6e7ce tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:12.230751 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90bbc4e0-210a-4a9a-9ca4-e4fd7ec6e7ce tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:12.375766 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO oslo.messaging._drivers.impl_rabbit [None req-cb368a1a-3215-433b-93d1-77aa92ee8b09 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [981ac677-9bc6-4895-8b89-4fe372b419d8] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 45232. Aug 10 17:24:12.382491 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cb368a1a-3215-433b-93d1-77aa92ee8b09 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "DELETE /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3/os-volume_attachments/3d628473-24be-4ca9-a263-005d48b4482a" status: 202 len: 0 microversion: 2.1 time: 1.434582 Aug 10 17:24:12.383661 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 517/1047] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 17:24:10 2022] DELETE /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3/os-volume_attachments/3d628473-24be-4ca9-a263-005d48b4482a => generated 0 bytes in 1437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:24:12.387099 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-90bbc4e0-210a-4a9a-9ca4-e4fd7ec6e7ce tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:12.397054 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-90bbc4e0-210a-4a9a-9ca4-e4fd7ec6e7ce tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.180413 Aug 10 17:24:12.397715 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 531/1048] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:12 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:24:13.421646 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-73a955c7-071a-4b6f-8a4d-66dd82c4695c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:13.422339 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-73a955c7-071a-4b6f-8a4d-66dd82c4695c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:13.429065 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73a955c7-071a-4b6f-8a4d-66dd82c4695c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:13.429551 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73a955c7-071a-4b6f-8a4d-66dd82c4695c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:13.429984 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73a955c7-071a-4b6f-8a4d-66dd82c4695c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:13.430704 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73a955c7-071a-4b6f-8a4d-66dd82c4695c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:13.431153 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73a955c7-071a-4b6f-8a4d-66dd82c4695c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:13.431574 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73a955c7-071a-4b6f-8a4d-66dd82c4695c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:13.592015 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-73a955c7-071a-4b6f-8a4d-66dd82c4695c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:13.599599 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-73a955c7-071a-4b6f-8a4d-66dd82c4695c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.183409 Aug 10 17:24:13.600172 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 518/1049] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:13 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:14.621855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2f3d73b7-66b6-4ebe-bb22-5ebfa6156952 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:14.622506 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2f3d73b7-66b6-4ebe-bb22-5ebfa6156952 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:14.629157 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f3d73b7-66b6-4ebe-bb22-5ebfa6156952 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:14.636473 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f3d73b7-66b6-4ebe-bb22-5ebfa6156952 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:14.636473 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f3d73b7-66b6-4ebe-bb22-5ebfa6156952 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:14.636473 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f3d73b7-66b6-4ebe-bb22-5ebfa6156952 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:14.636473 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f3d73b7-66b6-4ebe-bb22-5ebfa6156952 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:14.636982 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f3d73b7-66b6-4ebe-bb22-5ebfa6156952 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:14.764421 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2f3d73b7-66b6-4ebe-bb22-5ebfa6156952 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:14.772125 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2f3d73b7-66b6-4ebe-bb22-5ebfa6156952 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.154718 Aug 10 17:24:14.772685 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 532/1050] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:14 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:15.793766 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a697e28f-fd46-4f72-9e6b-a9fce6857a15 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:15.794418 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a697e28f-fd46-4f72-9e6b-a9fce6857a15 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:15.800947 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a697e28f-fd46-4f72-9e6b-a9fce6857a15 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:15.801431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a697e28f-fd46-4f72-9e6b-a9fce6857a15 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:15.801869 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a697e28f-fd46-4f72-9e6b-a9fce6857a15 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:15.802598 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a697e28f-fd46-4f72-9e6b-a9fce6857a15 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:15.803052 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a697e28f-fd46-4f72-9e6b-a9fce6857a15 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:15.803475 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a697e28f-fd46-4f72-9e6b-a9fce6857a15 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:15.942371 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a697e28f-fd46-4f72-9e6b-a9fce6857a15 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:15.950839 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a697e28f-fd46-4f72-9e6b-a9fce6857a15 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.161636 Aug 10 17:24:15.951408 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 519/1051] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:15 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:16.465569 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-f860e74f-5153-482b-aabf-c1e4e5cba395 req-df670596-13fd-4a7b-a28a-ccfa89f0aa8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caefb81a-86e7-4a4c-a2da-facc23b171a0", "tag": "19d9e0b4-68d1-4399-9066-18eab4717e02"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:24:16.475430 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f860e74f-5153-482b-aabf-c1e4e5cba395 req-df670596-13fd-4a7b-a28a-ccfa89f0aa8f service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:16.476021 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f860e74f-5153-482b-aabf-c1e4e5cba395 req-df670596-13fd-4a7b-a28a-ccfa89f0aa8f service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:16.476529 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f860e74f-5153-482b-aabf-c1e4e5cba395 req-df670596-13fd-4a7b-a28a-ccfa89f0aa8f service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:16.488995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-f860e74f-5153-482b-aabf-c1e4e5cba395 req-df670596-13fd-4a7b-a28a-ccfa89f0aa8f service nova] Creating event network-changed:19d9e0b4-68d1-4399-9066-18eab4717e02 for instance caefb81a-86e7-4a4c-a2da-facc23b171a0 on hv-cinder-85272 Aug 10 17:24:16.494605 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-f860e74f-5153-482b-aabf-c1e4e5cba395 req-df670596-13fd-4a7b-a28a-ccfa89f0aa8f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032761 Aug 10 17:24:16.495891 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 533/1052] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:24:16.712117 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-81ae2823-33de-4c6b-8092-446e03e87146 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:16.712673 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-81ae2823-33de-4c6b-8092-446e03e87146 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:16.719513 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81ae2823-33de-4c6b-8092-446e03e87146 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:16.720081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81ae2823-33de-4c6b-8092-446e03e87146 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:16.720595 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81ae2823-33de-4c6b-8092-446e03e87146 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:16.721382 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81ae2823-33de-4c6b-8092-446e03e87146 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:16.721935 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81ae2823-33de-4c6b-8092-446e03e87146 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:16.722603 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-81ae2823-33de-4c6b-8092-446e03e87146 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:16.749733 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-81ae2823-33de-4c6b-8092-446e03e87146 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:24:16.972717 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-62623844-750c-47f7-b254-4cab305195fe tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:16.973346 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-62623844-750c-47f7-b254-4cab305195fe tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:16.979455 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62623844-750c-47f7-b254-4cab305195fe tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:16.980050 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62623844-750c-47f7-b254-4cab305195fe tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:16.980487 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62623844-750c-47f7-b254-4cab305195fe tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:16.981217 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62623844-750c-47f7-b254-4cab305195fe tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:16.981671 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62623844-750c-47f7-b254-4cab305195fe tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:16.982100 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62623844-750c-47f7-b254-4cab305195fe tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:17.125457 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-62623844-750c-47f7-b254-4cab305195fe tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:17.133335 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-62623844-750c-47f7-b254-4cab305195fe tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.164960 Aug 10 17:24:17.133909 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 534/1053] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:16 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:24:17.157168 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-81ae2823-33de-4c6b-8092-446e03e87146 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "DELETE /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 204 len: 0 microversion: 2.1 time: 0.449034 Aug 10 17:24:17.157759 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 520/1054] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:24:16 2022] DELETE /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 17:24:17.172113 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bed20881-3f55-47ff-8a4b-0cd3adfc6357 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:17.172728 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bed20881-3f55-47ff-8a4b-0cd3adfc6357 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:17.178724 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bed20881-3f55-47ff-8a4b-0cd3adfc6357 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:17.179211 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bed20881-3f55-47ff-8a4b-0cd3adfc6357 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:17.179653 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bed20881-3f55-47ff-8a4b-0cd3adfc6357 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:17.180348 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bed20881-3f55-47ff-8a4b-0cd3adfc6357 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:17.180805 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bed20881-3f55-47ff-8a4b-0cd3adfc6357 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:17.181235 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bed20881-3f55-47ff-8a4b-0cd3adfc6357 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:17.311972 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bed20881-3f55-47ff-8a4b-0cd3adfc6357 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:17.319516 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bed20881-3f55-47ff-8a4b-0cd3adfc6357 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1514 microversion: 2.1 time: 0.151411 Aug 10 17:24:17.320074 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 535/1055] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:17 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:24:18.155098 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a5c84650-7053-485b-bd9d-2ad6e9c2bb6a tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:18.155800 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a5c84650-7053-485b-bd9d-2ad6e9c2bb6a tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:18.162541 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a5c84650-7053-485b-bd9d-2ad6e9c2bb6a tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:18.163163 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a5c84650-7053-485b-bd9d-2ad6e9c2bb6a tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:18.163452 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a5c84650-7053-485b-bd9d-2ad6e9c2bb6a tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:18.164151 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a5c84650-7053-485b-bd9d-2ad6e9c2bb6a tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:18.164605 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a5c84650-7053-485b-bd9d-2ad6e9c2bb6a tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:18.165026 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a5c84650-7053-485b-bd9d-2ad6e9c2bb6a tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:18.299695 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a5c84650-7053-485b-bd9d-2ad6e9c2bb6a tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:18.307267 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a5c84650-7053-485b-bd9d-2ad6e9c2bb6a tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.157072 Aug 10 17:24:18.307833 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 521/1056] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:18 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:18.340821 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e33cdf1c-aa96-4697-8421-0c0330a29781 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:18.341425 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e33cdf1c-aa96-4697-8421-0c0330a29781 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:18.347947 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e33cdf1c-aa96-4697-8421-0c0330a29781 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:18.348438 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e33cdf1c-aa96-4697-8421-0c0330a29781 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:18.348873 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e33cdf1c-aa96-4697-8421-0c0330a29781 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:18.349566 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e33cdf1c-aa96-4697-8421-0c0330a29781 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:18.350022 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e33cdf1c-aa96-4697-8421-0c0330a29781 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:18.350496 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e33cdf1c-aa96-4697-8421-0c0330a29781 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:18.482841 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e33cdf1c-aa96-4697-8421-0c0330a29781 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:18.490461 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e33cdf1c-aa96-4697-8421-0c0330a29781 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1514 microversion: 2.1 time: 0.153946 Aug 10 17:24:18.491039 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 536/1057] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:18 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:19.394605 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-df3761c5-db6e-4a57-8b55-51e1babf65c0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:19.394605 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-df3761c5-db6e-4a57-8b55-51e1babf65c0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:19.394605 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df3761c5-db6e-4a57-8b55-51e1babf65c0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:19.394605 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df3761c5-db6e-4a57-8b55-51e1babf65c0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:19.397437 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df3761c5-db6e-4a57-8b55-51e1babf65c0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:19.397437 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df3761c5-db6e-4a57-8b55-51e1babf65c0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:19.397437 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df3761c5-db6e-4a57-8b55-51e1babf65c0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:19.397437 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df3761c5-db6e-4a57-8b55-51e1babf65c0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:19.481926 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-df3761c5-db6e-4a57-8b55-51e1babf65c0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:19.489792 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-df3761c5-db6e-4a57-8b55-51e1babf65c0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.165514 Aug 10 17:24:19.490406 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 522/1058] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:19 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:19.514425 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0a2c4db4-9b26-4157-b49f-8c6b60a30579 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:19.515039 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0a2c4db4-9b26-4157-b49f-8c6b60a30579 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:19.521354 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0a2c4db4-9b26-4157-b49f-8c6b60a30579 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:19.521877 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0a2c4db4-9b26-4157-b49f-8c6b60a30579 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:19.522341 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0a2c4db4-9b26-4157-b49f-8c6b60a30579 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:19.523136 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0a2c4db4-9b26-4157-b49f-8c6b60a30579 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:19.523618 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0a2c4db4-9b26-4157-b49f-8c6b60a30579 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:19.524046 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0a2c4db4-9b26-4157-b49f-8c6b60a30579 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:19.676386 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0a2c4db4-9b26-4157-b49f-8c6b60a30579 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:19.685102 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0a2c4db4-9b26-4157-b49f-8c6b60a30579 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1514 microversion: 2.1 time: 0.175457 Aug 10 17:24:19.685685 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 537/1059] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:19 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:20.189713 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-cf39be27-6b81-45b6-9c25-7dc8a2300bf3 req-664d665f-6d33-485f-8a67-562978b879ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331b2dee-c26f-453d-9790-4e55f5e8e7c3", "name": "network-vif-deleted", "tag": "00331a72-0b63-4771-a1e3-9b24b55ec47b"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:24:20.200205 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-cf39be27-6b81-45b6-9c25-7dc8a2300bf3 req-664d665f-6d33-485f-8a67-562978b879ab service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:20.200726 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-cf39be27-6b81-45b6-9c25-7dc8a2300bf3 req-664d665f-6d33-485f-8a67-562978b879ab service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:20.201231 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-cf39be27-6b81-45b6-9c25-7dc8a2300bf3 req-664d665f-6d33-485f-8a67-562978b879ab service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:20.212542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-cf39be27-6b81-45b6-9c25-7dc8a2300bf3 req-664d665f-6d33-485f-8a67-562978b879ab service nova] Creating event network-vif-deleted:00331a72-0b63-4771-a1e3-9b24b55ec47b for instance 331b2dee-c26f-453d-9790-4e55f5e8e7c3 on hv-cinder-85272 Aug 10 17:24:20.217834 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-cf39be27-6b81-45b6-9c25-7dc8a2300bf3 req-664d665f-6d33-485f-8a67-562978b879ab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031918 Aug 10 17:24:20.222244 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 523/1060] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:24:20.512874 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f6a7dd8f-27a0-4b0d-9632-5dcc21e86042 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:20.513407 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f6a7dd8f-27a0-4b0d-9632-5dcc21e86042 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:20.519902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6a7dd8f-27a0-4b0d-9632-5dcc21e86042 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:20.520466 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6a7dd8f-27a0-4b0d-9632-5dcc21e86042 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:20.520816 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6a7dd8f-27a0-4b0d-9632-5dcc21e86042 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:20.521516 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6a7dd8f-27a0-4b0d-9632-5dcc21e86042 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:20.521975 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6a7dd8f-27a0-4b0d-9632-5dcc21e86042 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:20.522465 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6a7dd8f-27a0-4b0d-9632-5dcc21e86042 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:20.658187 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f6a7dd8f-27a0-4b0d-9632-5dcc21e86042 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:20.665611 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f6a7dd8f-27a0-4b0d-9632-5dcc21e86042 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.157211 Aug 10 17:24:20.666174 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 538/1061] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:20 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:20.707716 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6b6c128a-2bf7-40f7-85f4-45952f77021c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:20.708427 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6b6c128a-2bf7-40f7-85f4-45952f77021c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:20.714582 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b6c128a-2bf7-40f7-85f4-45952f77021c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:20.715820 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b6c128a-2bf7-40f7-85f4-45952f77021c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:20.716260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b6c128a-2bf7-40f7-85f4-45952f77021c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:20.716955 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b6c128a-2bf7-40f7-85f4-45952f77021c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:20.717420 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b6c128a-2bf7-40f7-85f4-45952f77021c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:20.717848 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b6c128a-2bf7-40f7-85f4-45952f77021c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:20.784301 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6b6c128a-2bf7-40f7-85f4-45952f77021c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:20.792030 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6b6c128a-2bf7-40f7-85f4-45952f77021c tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1472 microversion: 2.1 time: 0.089283 Aug 10 17:24:20.792599 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 524/1062] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:20 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1472 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:21.687313 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6d2360e4-3c00-40d0-acfc-e1e2e534b12b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:21.688140 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6d2360e4-3c00-40d0-acfc-e1e2e534b12b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:21.695857 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d2360e4-3c00-40d0-acfc-e1e2e534b12b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:21.696356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d2360e4-3c00-40d0-acfc-e1e2e534b12b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:21.696828 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d2360e4-3c00-40d0-acfc-e1e2e534b12b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:21.697594 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d2360e4-3c00-40d0-acfc-e1e2e534b12b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:21.698109 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d2360e4-3c00-40d0-acfc-e1e2e534b12b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:21.698670 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d2360e4-3c00-40d0-acfc-e1e2e534b12b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:21.813234 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-34379836-c2e2-48f6-a1a7-16ee98f16f8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:21.813866 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-34379836-c2e2-48f6-a1a7-16ee98f16f8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:21.820580 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34379836-c2e2-48f6-a1a7-16ee98f16f8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:21.827544 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34379836-c2e2-48f6-a1a7-16ee98f16f8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:21.827544 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34379836-c2e2-48f6-a1a7-16ee98f16f8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:21.827544 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34379836-c2e2-48f6-a1a7-16ee98f16f8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:21.827544 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34379836-c2e2-48f6-a1a7-16ee98f16f8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:21.828068 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34379836-c2e2-48f6-a1a7-16ee98f16f8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:21.849607 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6d2360e4-3c00-40d0-acfc-e1e2e534b12b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:21.857321 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34379836-c2e2-48f6-a1a7-16ee98f16f8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:21.858047 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34379836-c2e2-48f6-a1a7-16ee98f16f8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:21.858222 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6d2360e4-3c00-40d0-acfc-e1e2e534b12b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.175579 Aug 10 17:24:21.858533 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-34379836-c2e2-48f6-a1a7-16ee98f16f8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:21.863015 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 539/1063] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:21 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:21.863222 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-34379836-c2e2-48f6-a1a7-16ee98f16f8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lazy-loading 'fault' on Instance uuid 331b2dee-c26f-453d-9790-4e55f5e8e7c3 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:24:21.900448 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-34379836-c2e2-48f6-a1a7-16ee98f16f8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:21.911411 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-34379836-c2e2-48f6-a1a7-16ee98f16f8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 200 len: 1309 microversion: 2.1 time: 0.102129 Aug 10 17:24:21.912007 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 525/1064] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:21 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:24:22.879562 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ea548ee5-6037-4aca-be84-5a7ef9da43cc tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:22.880130 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ea548ee5-6037-4aca-be84-5a7ef9da43cc tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:22.887560 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea548ee5-6037-4aca-be84-5a7ef9da43cc tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:22.888205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea548ee5-6037-4aca-be84-5a7ef9da43cc tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:22.888643 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea548ee5-6037-4aca-be84-5a7ef9da43cc tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:22.889368 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea548ee5-6037-4aca-be84-5a7ef9da43cc tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:22.889817 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea548ee5-6037-4aca-be84-5a7ef9da43cc tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:22.890244 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea548ee5-6037-4aca-be84-5a7ef9da43cc tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:22.933265 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1505a8f4-d325-4ebd-97fa-9cc7ed701b05 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:22.933888 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1505a8f4-d325-4ebd-97fa-9cc7ed701b05 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 331b2dee-c26f-453d-9790-4e55f5e8e7c3] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:22.940060 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1505a8f4-d325-4ebd-97fa-9cc7ed701b05 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:22.940558 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1505a8f4-d325-4ebd-97fa-9cc7ed701b05 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:22.941004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1505a8f4-d325-4ebd-97fa-9cc7ed701b05 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:22.941706 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1505a8f4-d325-4ebd-97fa-9cc7ed701b05 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:22.942166 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1505a8f4-d325-4ebd-97fa-9cc7ed701b05 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:22.942664 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1505a8f4-d325-4ebd-97fa-9cc7ed701b05 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:22.956858 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-1505a8f4-d325-4ebd-97fa-9cc7ed701b05 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] HTTP exception thrown: Instance 331b2dee-c26f-453d-9790-4e55f5e8e7c3 could not be found. Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1505a8f4-d325-4ebd-97fa-9cc7ed701b05 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Request method failure captured: Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 HTTP/1.1 Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-l268e5eO98ni4FcNstzf9fTMyyTIo9OZWFpfrj98Ovg9l47SA7mHHQJLQWQcwoyLyIKSUeFnAIBbkAhFkZNWh7hDSXBMyGhTqTiCWJFnrPaSwO5YbVyHR8VBxHygY3s6hObDIY7BHOqAj9WIbdcGbgSfa8qtits2raBvziirKhqho Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: a49a6fc2c18d44b8a8b82307021355fd Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesSnapshotTestJSON-275177936 Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:24:22.958561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:24:22.960155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a49a6fc2c18d44b8a8b82307021355fd", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a49a6fc2c18d44b8a8b82307021355fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a49a6fc2c18d44b8a8b82307021355fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a49a6fc2c18d44b8a8b82307021355fd"}]}] Aug 10 17:24:22.960155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesSnapshotTestJSON-275177936 Aug 10 17:24:22.960155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: a49a6fc2c18d44b8a8b82307021355fd Aug 10 17:24:22.960155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-275177936 Aug 10 17:24:22.960155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesSnapshotTestJSON-275177936-project Aug 10 17:24:22.960155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:24:22.960155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:24:22.960155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 0d7d26ea8e26466f91b1905aa1e2e156 Aug 10 17:24:22.960155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesSnapshotTestJSON-275177936-project Aug 10 17:24:22.960155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:24:22.960155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance 331b2dee-c26f-453d-9790-4e55f5e8e7c3 could not be found. Aug 10 17:24:22.960155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': '331b2dee-c26f-453d-9790-4e55f5e8e7c3'} Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 331b2dee-c26f-453d-9790-4e55f5e8e7c3 could not be found. Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:24:22.967150 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 331b2dee-c26f-453d-9790-4e55f5e8e7c3 could not be found. Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 331b2dee-c26f-453d-9790-4e55f5e8e7c3 could not be found. Aug 10 17:24:22.968893 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:24:22.970134 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1505a8f4-d325-4ebd-97fa-9cc7ed701b05 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Returning 404 to user: Instance 331b2dee-c26f-453d-9790-4e55f5e8e7c3 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:24:22.970134 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1505a8f4-d325-4ebd-97fa-9cc7ed701b05 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3" status: 404 len: 111 microversion: 2.1 time: 0.030873 Aug 10 17:24:22.970134 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 526/1065] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:22 2022] GET /compute/v2.1/servers/331b2dee-c26f-453d-9790-4e55f5e8e7c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 17:24:23.031622 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ea548ee5-6037-4aca-be84-5a7ef9da43cc tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:23.039241 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ea548ee5-6037-4aca-be84-5a7ef9da43cc tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.163631 Aug 10 17:24:23.039923 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 540/1066] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:22 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:23.263715 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-5a30c4bf-0d09-484d-a753-07f4a59c12f7 req-b333b803-6e98-428e-a357-9b58e975f4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caefb81a-86e7-4a4c-a2da-facc23b171a0", "name": "network-vif-plugged", "status": "completed", "tag": "19d9e0b4-68d1-4399-9066-18eab4717e02"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:24:23.274015 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-5a30c4bf-0d09-484d-a753-07f4a59c12f7 req-b333b803-6e98-428e-a357-9b58e975f4aa service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:23.281292 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-5a30c4bf-0d09-484d-a753-07f4a59c12f7 req-b333b803-6e98-428e-a357-9b58e975f4aa service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:23.281292 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-5a30c4bf-0d09-484d-a753-07f4a59c12f7 req-b333b803-6e98-428e-a357-9b58e975f4aa service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:23.289164 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-5a30c4bf-0d09-484d-a753-07f4a59c12f7 req-b333b803-6e98-428e-a357-9b58e975f4aa service nova] Creating event network-vif-plugged:19d9e0b4-68d1-4399-9066-18eab4717e02 for instance caefb81a-86e7-4a4c-a2da-facc23b171a0 on hv-cinder-85272 Aug 10 17:24:23.293992 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-5a30c4bf-0d09-484d-a753-07f4a59c12f7 req-b333b803-6e98-428e-a357-9b58e975f4aa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034897 Aug 10 17:24:23.295441 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 527/1067] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:24:24.061292 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-434c0301-1d5d-442c-957b-02872dea2ad1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:24.061849 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-434c0301-1d5d-442c-957b-02872dea2ad1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:24.068164 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-434c0301-1d5d-442c-957b-02872dea2ad1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:24.068644 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-434c0301-1d5d-442c-957b-02872dea2ad1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:24.069081 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-434c0301-1d5d-442c-957b-02872dea2ad1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:24.069761 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-434c0301-1d5d-442c-957b-02872dea2ad1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:24.070211 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-434c0301-1d5d-442c-957b-02872dea2ad1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:24.070660 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-434c0301-1d5d-442c-957b-02872dea2ad1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:24.204638 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-434c0301-1d5d-442c-957b-02872dea2ad1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:24.212689 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-434c0301-1d5d-442c-957b-02872dea2ad1 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.155396 Aug 10 17:24:24.213398 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 541/1068] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:24 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:25.236367 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c4bf79af-048d-48de-9f7c-3f0a04a822b2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:25.237077 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c4bf79af-048d-48de-9f7c-3f0a04a822b2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:25.243506 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4bf79af-048d-48de-9f7c-3f0a04a822b2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:25.243992 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4bf79af-048d-48de-9f7c-3f0a04a822b2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:25.244442 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4bf79af-048d-48de-9f7c-3f0a04a822b2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:25.245136 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4bf79af-048d-48de-9f7c-3f0a04a822b2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:25.245667 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4bf79af-048d-48de-9f7c-3f0a04a822b2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:25.246099 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4bf79af-048d-48de-9f7c-3f0a04a822b2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:25.379023 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c4bf79af-048d-48de-9f7c-3f0a04a822b2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:25.383032 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:24:25.387286 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c4bf79af-048d-48de-9f7c-3f0a04a822b2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.156413 Aug 10 17:24:25.387864 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 528/1069] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:25 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:24:26.407341 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e8d35ae8-ea81-4660-b26c-611737805caa tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:26.407949 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e8d35ae8-ea81-4660-b26c-611737805caa tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:26.410379 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:24:26.415088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8d35ae8-ea81-4660-b26c-611737805caa tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:26.415574 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8d35ae8-ea81-4660-b26c-611737805caa tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:26.416008 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8d35ae8-ea81-4660-b26c-611737805caa tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:26.416705 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8d35ae8-ea81-4660-b26c-611737805caa tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:26.417160 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8d35ae8-ea81-4660-b26c-611737805caa tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:26.417578 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8d35ae8-ea81-4660-b26c-611737805caa tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:26.566063 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e8d35ae8-ea81-4660-b26c-611737805caa tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:26.572471 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:24:26.574074 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e8d35ae8-ea81-4660-b26c-611737805caa tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.170708 Aug 10 17:24:26.574690 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 542/1070] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:26 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:27.596349 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-013ec301-a461-4598-962e-27b563b17966 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:27.597003 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-013ec301-a461-4598-962e-27b563b17966 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:27.599520 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:24:27.604770 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-013ec301-a461-4598-962e-27b563b17966 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:27.605837 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-013ec301-a461-4598-962e-27b563b17966 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:27.606030 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-013ec301-a461-4598-962e-27b563b17966 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:27.607178 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-013ec301-a461-4598-962e-27b563b17966 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:27.607638 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-013ec301-a461-4598-962e-27b563b17966 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:27.608070 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-013ec301-a461-4598-962e-27b563b17966 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:27.749148 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-013ec301-a461-4598-962e-27b563b17966 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:27.753248 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-013ec301-a461-4598-962e-27b563b17966 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1359 microversion: 2.1 time: 0.161918 Aug 10 17:24:27.760083 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 529/1071] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:27 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:28.775656 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-025c839c-97a1-40dc-936f-7f2c1d435c3e tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:28.776208 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-025c839c-97a1-40dc-936f-7f2c1d435c3e tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:28.784376 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-025c839c-97a1-40dc-936f-7f2c1d435c3e tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:28.784871 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-025c839c-97a1-40dc-936f-7f2c1d435c3e tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:28.785314 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-025c839c-97a1-40dc-936f-7f2c1d435c3e tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:28.786090 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-025c839c-97a1-40dc-936f-7f2c1d435c3e tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:28.786577 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-025c839c-97a1-40dc-936f-7f2c1d435c3e tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:28.787011 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-025c839c-97a1-40dc-936f-7f2c1d435c3e tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:28.921215 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-025c839c-97a1-40dc-936f-7f2c1d435c3e tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:28.929060 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-025c839c-97a1-40dc-936f-7f2c1d435c3e tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1548 microversion: 2.1 time: 0.157371 Aug 10 17:24:28.929633 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 543/1072] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:28 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:28.951077 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cd439e1b-e72e-4519-99c5-553ff1ce3688 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:28.951817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cd439e1b-e72e-4519-99c5-553ff1ce3688 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:28.959317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cd439e1b-e72e-4519-99c5-553ff1ce3688 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:28.959842 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cd439e1b-e72e-4519-99c5-553ff1ce3688 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:28.960284 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cd439e1b-e72e-4519-99c5-553ff1ce3688 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:28.960997 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cd439e1b-e72e-4519-99c5-553ff1ce3688 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:28.961452 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cd439e1b-e72e-4519-99c5-553ff1ce3688 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:28.961880 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cd439e1b-e72e-4519-99c5-553ff1ce3688 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:29.097729 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cd439e1b-e72e-4519-99c5-553ff1ce3688 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:29.105205 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cd439e1b-e72e-4519-99c5-553ff1ce3688 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1548 microversion: 2.1 time: 0.159389 Aug 10 17:24:29.105774 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 530/1073] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:28 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:29.138152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8ce08a30-0d40-4a2f-a307-81fe3296154c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:29.143077 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8ce08a30-0d40-4a2f-a307-81fe3296154c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:29.143848 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8ce08a30-0d40-4a2f-a307-81fe3296154c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Searching by: {'deleted': False, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7'} {{(pid=121232) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 17:24:29.150551 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ce08a30-0d40-4a2f-a307-81fe3296154c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:29.151036 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ce08a30-0d40-4a2f-a307-81fe3296154c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:29.151479 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ce08a30-0d40-4a2f-a307-81fe3296154c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:29.152211 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ce08a30-0d40-4a2f-a307-81fe3296154c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:29.152669 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ce08a30-0d40-4a2f-a307-81fe3296154c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:29.153100 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ce08a30-0d40-4a2f-a307-81fe3296154c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:29.249084 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.multi_cell_list [None req-8ce08a30-0d40-4a2f-a307-81fe3296154c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121232) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 17:24:29.354142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8ce08a30-0d40-4a2f-a307-81fe3296154c tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.220210 Aug 10 17:24:29.354771 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 544/1074] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Aug 10 17:24:29 2022] GET /compute/v2.1/servers => generated 343 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:24:29.366762 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-63ce3c77-444c-4c56-8e7b-6897c7d7b6f2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:29.367379 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-63ce3c77-444c-4c56-8e7b-6897c7d7b6f2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:29.373589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63ce3c77-444c-4c56-8e7b-6897c7d7b6f2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:29.382799 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63ce3c77-444c-4c56-8e7b-6897c7d7b6f2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:29.382799 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63ce3c77-444c-4c56-8e7b-6897c7d7b6f2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:29.382799 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63ce3c77-444c-4c56-8e7b-6897c7d7b6f2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:29.382799 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63ce3c77-444c-4c56-8e7b-6897c7d7b6f2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:29.383212 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63ce3c77-444c-4c56-8e7b-6897c7d7b6f2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:29.512726 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-63ce3c77-444c-4c56-8e7b-6897c7d7b6f2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:29.520794 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-63ce3c77-444c-4c56-8e7b-6897c7d7b6f2 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1548 microversion: 2.1 time: 0.157843 Aug 10 17:24:29.521393 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 531/1075] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:29 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:30.988004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:24:30.988782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Wed Aug 10 17:24:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:24:33.576293 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2106504172", "imageRef": "99bea5a1-0390-4b68-844b-988b008f265e", "flavorRef": "452", "networks": [{"uuid": "8d021d76-7ee6-4e91-9684-951a3c45eb44"}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:24:33.623222 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fb0ea79a-fd01-4b8e-a12a-716a0b03bc0d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59dc0d2b-bf42-4153-9319-9c5b05ccadba"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:24:33.625671 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fb0ea79a-fd01-4b8e-a12a-716a0b03bc0d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:33.633527 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb0ea79a-fd01-4b8e-a12a-716a0b03bc0d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:33.633887 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] validate_networks() for [('8d021d76-7ee6-4e91-9684-951a3c45eb44', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:24:33.634023 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb0ea79a-fd01-4b8e-a12a-716a0b03bc0d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:33.634468 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb0ea79a-fd01-4b8e-a12a-716a0b03bc0d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:33.635166 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb0ea79a-fd01-4b8e-a12a-716a0b03bc0d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:33.635623 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb0ea79a-fd01-4b8e-a12a-716a0b03bc0d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:33.636049 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb0ea79a-fd01-4b8e-a12a-716a0b03bc0d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:34.008500 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:24:34.008920 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:24:34.009394 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:24:34.009800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:24:34.010209 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:24:34.019476 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:34.019974 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:34.020432 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:34.021152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:34.021600 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:34.022018 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:34.039282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Getting quotas for project a49a6fc2c18d44b8a8b82307021355fd. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:24:34.043168 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Getting quotas for user 0d7d26ea8e26466f91b1905aa1e2e156 and project a49a6fc2c18d44b8a8b82307021355fd. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:24:34.054565 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:24:34.056783 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99bea5a1-0390-4b68-844b-988b008f265e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:24:34.198456 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c080e85b-0087-4672-88d3-bd4656342359 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626048 Aug 10 17:24:34.199149 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 545/1076] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:24:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:24:34.210445 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bbc75f03-2d03-47c2-bdd6-d23bc4a6bc0a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:34.211264 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bbc75f03-2d03-47c2-bdd6-d23bc4a6bc0a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:34.266943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bbc75f03-2d03-47c2-bdd6-d23bc4a6bc0a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:34.273688 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bbc75f03-2d03-47c2-bdd6-d23bc4a6bc0a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1219 microversion: 2.1 time: 0.066941 Aug 10 17:24:34.274397 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 546/1077] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:34 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:24:34.405639 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fb0ea79a-fd01-4b8e-a12a-716a0b03bc0d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "POST /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.786285 Aug 10 17:24:34.406870 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 532/1078] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 17:24:33 2022] POST /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/os-volume_attachments => generated 194 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:24:35.294952 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-04aa653c-bd31-4ce2-9ea5-eafba0e053fa tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:35.295564 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-04aa653c-bd31-4ce2-9ea5-eafba0e053fa tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:35.302408 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04aa653c-bd31-4ce2-9ea5-eafba0e053fa tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:35.302902 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04aa653c-bd31-4ce2-9ea5-eafba0e053fa tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:35.303339 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04aa653c-bd31-4ce2-9ea5-eafba0e053fa tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:35.304034 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04aa653c-bd31-4ce2-9ea5-eafba0e053fa tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:35.304493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04aa653c-bd31-4ce2-9ea5-eafba0e053fa tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:35.304929 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04aa653c-bd31-4ce2-9ea5-eafba0e053fa tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:35.367682 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-04aa653c-bd31-4ce2-9ea5-eafba0e053fa tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:35.375965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-04aa653c-bd31-4ce2-9ea5-eafba0e053fa tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1223 microversion: 2.1 time: 0.084841 Aug 10 17:24:35.376547 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 547/1079] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:35 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:36.398161 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-768a1762-a0c1-4a28-bb1d-e31c0a9306ae tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:36.398829 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-768a1762-a0c1-4a28-bb1d-e31c0a9306ae tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:36.404991 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-768a1762-a0c1-4a28-bb1d-e31c0a9306ae tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:36.405475 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-768a1762-a0c1-4a28-bb1d-e31c0a9306ae tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:36.405945 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-768a1762-a0c1-4a28-bb1d-e31c0a9306ae tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:36.406627 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-768a1762-a0c1-4a28-bb1d-e31c0a9306ae tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:36.407078 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-768a1762-a0c1-4a28-bb1d-e31c0a9306ae tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:36.407499 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-768a1762-a0c1-4a28-bb1d-e31c0a9306ae tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:36.473139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-768a1762-a0c1-4a28-bb1d-e31c0a9306ae tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:36.480466 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-768a1762-a0c1-4a28-bb1d-e31c0a9306ae tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1271 microversion: 2.1 time: 0.087189 Aug 10 17:24:36.485882 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 533/1080] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:36 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:37.502300 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c6f4e0ee-9e3b-4a52-b0d7-302ee5e0ee52 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:37.503174 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c6f4e0ee-9e3b-4a52-b0d7-302ee5e0ee52 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:37.509844 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6f4e0ee-9e3b-4a52-b0d7-302ee5e0ee52 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:37.510331 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6f4e0ee-9e3b-4a52-b0d7-302ee5e0ee52 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:37.510799 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6f4e0ee-9e3b-4a52-b0d7-302ee5e0ee52 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:37.511505 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6f4e0ee-9e3b-4a52-b0d7-302ee5e0ee52 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:37.512111 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6f4e0ee-9e3b-4a52-b0d7-302ee5e0ee52 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:37.512536 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6f4e0ee-9e3b-4a52-b0d7-302ee5e0ee52 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:37.656854 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c6f4e0ee-9e3b-4a52-b0d7-302ee5e0ee52 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:37.666109 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c6f4e0ee-9e3b-4a52-b0d7-302ee5e0ee52 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1319 microversion: 2.1 time: 0.168216 Aug 10 17:24:37.666696 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 548/1081] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:37 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:37.788626 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f86f27cb-4ab1-4e11-b997-8ebeb8e645d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:37.789369 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f86f27cb-4ab1-4e11-b997-8ebeb8e645d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:37.795894 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f86f27cb-4ab1-4e11-b997-8ebeb8e645d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:37.796383 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f86f27cb-4ab1-4e11-b997-8ebeb8e645d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:37.796993 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f86f27cb-4ab1-4e11-b997-8ebeb8e645d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:37.797707 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f86f27cb-4ab1-4e11-b997-8ebeb8e645d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:37.798169 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f86f27cb-4ab1-4e11-b997-8ebeb8e645d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:37.798617 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f86f27cb-4ab1-4e11-b997-8ebeb8e645d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:37.933107 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f86f27cb-4ab1-4e11-b997-8ebeb8e645d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:37.941598 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f86f27cb-4ab1-4e11-b997-8ebeb8e645d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1594 microversion: 2.1 time: 0.156809 Aug 10 17:24:37.942188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 534/1082] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:37 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:38.521408 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-934c1da5-ea13-40ff-b870-c66a267f6977 req-c9ee354b-0314-49aa-a164-dc4a63bc8818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6259fafc-cdda-4758-b14b-f31c513d5c7d", "tag": "87408352-381c-4a01-9849-34e6eb3a110f"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:24:38.534260 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-934c1da5-ea13-40ff-b870-c66a267f6977 req-c9ee354b-0314-49aa-a164-dc4a63bc8818 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:38.534911 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-934c1da5-ea13-40ff-b870-c66a267f6977 req-c9ee354b-0314-49aa-a164-dc4a63bc8818 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:38.535438 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-934c1da5-ea13-40ff-b870-c66a267f6977 req-c9ee354b-0314-49aa-a164-dc4a63bc8818 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:38.548386 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-934c1da5-ea13-40ff-b870-c66a267f6977 req-c9ee354b-0314-49aa-a164-dc4a63bc8818 service nova] Creating event network-changed:87408352-381c-4a01-9849-34e6eb3a110f for instance 6259fafc-cdda-4758-b14b-f31c513d5c7d on hv-cinder-85272 Aug 10 17:24:38.553585 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-934c1da5-ea13-40ff-b870-c66a267f6977 req-c9ee354b-0314-49aa-a164-dc4a63bc8818 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036263 Aug 10 17:24:38.555083 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 549/1083] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:24:38.688861 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7e2c41e3-aed0-47f8-94a9-02dc2df9373f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:38.689886 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7e2c41e3-aed0-47f8-94a9-02dc2df9373f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:38.696113 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e2c41e3-aed0-47f8-94a9-02dc2df9373f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:38.696736 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e2c41e3-aed0-47f8-94a9-02dc2df9373f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:38.697292 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e2c41e3-aed0-47f8-94a9-02dc2df9373f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:38.698175 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e2c41e3-aed0-47f8-94a9-02dc2df9373f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:38.698750 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e2c41e3-aed0-47f8-94a9-02dc2df9373f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:38.699233 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e2c41e3-aed0-47f8-94a9-02dc2df9373f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:38.949004 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7e2c41e3-aed0-47f8-94a9-02dc2df9373f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:38.958066 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7e2c41e3-aed0-47f8-94a9-02dc2df9373f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1319 microversion: 2.1 time: 0.274045 Aug 10 17:24:38.958913 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 535/1084] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:38 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:39.980674 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-29e72c96-ab46-48f2-9351-00dce54149f2 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:39.981522 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-29e72c96-ab46-48f2-9351-00dce54149f2 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:39.988415 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29e72c96-ab46-48f2-9351-00dce54149f2 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:39.988906 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29e72c96-ab46-48f2-9351-00dce54149f2 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:39.989351 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29e72c96-ab46-48f2-9351-00dce54149f2 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:39.990051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29e72c96-ab46-48f2-9351-00dce54149f2 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:39.990540 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29e72c96-ab46-48f2-9351-00dce54149f2 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:39.990997 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29e72c96-ab46-48f2-9351-00dce54149f2 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:40.416098 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-29e72c96-ab46-48f2-9351-00dce54149f2 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:40.420477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-f94ff67a-518e-426e-a09c-a3e60fd86c77 req-3903412c-1288-4dbe-be8d-398b3117f078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caefb81a-86e7-4a4c-a2da-facc23b171a0", "tag": "19d9e0b4-68d1-4399-9066-18eab4717e02"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:24:40.425630 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-29e72c96-ab46-48f2-9351-00dce54149f2 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1319 microversion: 2.1 time: 0.449559 Aug 10 17:24:40.426210 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 550/1085] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:39 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1319 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:40.437970 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f94ff67a-518e-426e-a09c-a3e60fd86c77 req-3903412c-1288-4dbe-be8d-398b3117f078 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:40.438724 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f94ff67a-518e-426e-a09c-a3e60fd86c77 req-3903412c-1288-4dbe-be8d-398b3117f078 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:40.439409 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f94ff67a-518e-426e-a09c-a3e60fd86c77 req-3903412c-1288-4dbe-be8d-398b3117f078 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:40.452414 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-f94ff67a-518e-426e-a09c-a3e60fd86c77 req-3903412c-1288-4dbe-be8d-398b3117f078 service nova] Creating event network-changed:19d9e0b4-68d1-4399-9066-18eab4717e02 for instance caefb81a-86e7-4a4c-a2da-facc23b171a0 on hv-cinder-85272 Aug 10 17:24:40.462199 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-f94ff67a-518e-426e-a09c-a3e60fd86c77 req-3903412c-1288-4dbe-be8d-398b3117f078 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042623 Aug 10 17:24:40.462199 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 536/1086] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:24:41.448061 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e0af96cc-3e67-4691-8f92-4723f3c5aa71 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:41.448744 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e0af96cc-3e67-4691-8f92-4723f3c5aa71 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:41.455951 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0af96cc-3e67-4691-8f92-4723f3c5aa71 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:41.456449 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0af96cc-3e67-4691-8f92-4723f3c5aa71 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:41.456984 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0af96cc-3e67-4691-8f92-4723f3c5aa71 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:41.457901 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0af96cc-3e67-4691-8f92-4723f3c5aa71 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:41.458379 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0af96cc-3e67-4691-8f92-4723f3c5aa71 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:41.458841 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0af96cc-3e67-4691-8f92-4723f3c5aa71 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:41.600000 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e0af96cc-3e67-4691-8f92-4723f3c5aa71 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:41.606323 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e0af96cc-3e67-4691-8f92-4723f3c5aa71 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1319 microversion: 2.1 time: 0.162528 Aug 10 17:24:41.606981 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 551/1087] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:41 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:42.629758 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f5139055-610a-4617-aa39-133fdfced353 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:42.637593 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f5139055-610a-4617-aa39-133fdfced353 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:42.637593 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f5139055-610a-4617-aa39-133fdfced353 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:42.637593 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f5139055-610a-4617-aa39-133fdfced353 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:42.637898 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f5139055-610a-4617-aa39-133fdfced353 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:42.638395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f5139055-610a-4617-aa39-133fdfced353 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:42.638849 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f5139055-610a-4617-aa39-133fdfced353 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:42.639272 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f5139055-610a-4617-aa39-133fdfced353 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:42.778653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f5139055-610a-4617-aa39-133fdfced353 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:42.786807 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f5139055-610a-4617-aa39-133fdfced353 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1319 microversion: 2.1 time: 0.162435 Aug 10 17:24:42.787367 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 537/1088] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:42 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:43.379530 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-481ca999-bb2b-4af0-a25c-b1247ccbc589 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-119128271"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:24:43.380859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-481ca999-bb2b-4af0-a25c-b1247ccbc589 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:43.387797 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-481ca999-bb2b-4af0-a25c-b1247ccbc589 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:43.388406 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-481ca999-bb2b-4af0-a25c-b1247ccbc589 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:43.388854 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-481ca999-bb2b-4af0-a25c-b1247ccbc589 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:43.389610 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-481ca999-bb2b-4af0-a25c-b1247ccbc589 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:43.390071 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-481ca999-bb2b-4af0-a25c-b1247ccbc589 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:43.390679 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-481ca999-bb2b-4af0-a25c-b1247ccbc589 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:43.422113 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-dadfd17c-e35d-4be3-8ef0-bd0a113347cf req-74ef6bfe-057c-48d0-bc65-7e694e0b3b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6259fafc-cdda-4758-b14b-f31c513d5c7d", "name": "network-vif-plugged", "status": "completed", "tag": "87408352-381c-4a01-9849-34e6eb3a110f"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:24:43.431820 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-dadfd17c-e35d-4be3-8ef0-bd0a113347cf req-74ef6bfe-057c-48d0-bc65-7e694e0b3b37 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:43.432300 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-dadfd17c-e35d-4be3-8ef0-bd0a113347cf req-74ef6bfe-057c-48d0-bc65-7e694e0b3b37 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:43.432726 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-dadfd17c-e35d-4be3-8ef0-bd0a113347cf req-74ef6bfe-057c-48d0-bc65-7e694e0b3b37 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:43.444438 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-dadfd17c-e35d-4be3-8ef0-bd0a113347cf req-74ef6bfe-057c-48d0-bc65-7e694e0b3b37 service nova] Creating event network-vif-plugged:87408352-381c-4a01-9849-34e6eb3a110f for instance 6259fafc-cdda-4758-b14b-f31c513d5c7d on hv-cinder-85272 Aug 10 17:24:43.449442 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-dadfd17c-e35d-4be3-8ef0-bd0a113347cf req-74ef6bfe-057c-48d0-bc65-7e694e0b3b37 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031518 Aug 10 17:24:43.450207 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 538/1089] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:24:43.527089 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.network.security_group_api [None req-481ca999-bb2b-4af0-a25c-b1247ccbc589 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Adding security group 7a25f3f8-67fb-4e16-b1b3-65d1e1fda7c8 to port 19d9e0b4-68d1-4399-9066-18eab4717e02 Aug 10 17:24:43.809706 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6c8074f4-372e-44de-8905-20727b52ad81 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:43.811423 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6c8074f4-372e-44de-8905-20727b52ad81 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:43.818846 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c8074f4-372e-44de-8905-20727b52ad81 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:43.820239 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c8074f4-372e-44de-8905-20727b52ad81 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:43.820962 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c8074f4-372e-44de-8905-20727b52ad81 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:43.821866 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c8074f4-372e-44de-8905-20727b52ad81 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:43.822552 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c8074f4-372e-44de-8905-20727b52ad81 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:43.823088 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c8074f4-372e-44de-8905-20727b52ad81 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:43.985712 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6c8074f4-372e-44de-8905-20727b52ad81 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:43.993141 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6c8074f4-372e-44de-8905-20727b52ad81 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1319 microversion: 2.1 time: 0.188721 Aug 10 17:24:43.993700 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 539/1090] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:43 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:24:44.021144 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-481ca999-bb2b-4af0-a25c-b1247ccbc589 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "POST /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/action" status: 202 len: 0 microversion: 2.1 time: 0.646272 Aug 10 17:24:44.021729 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 552/1091] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:24:43 2022] POST /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:24:44.030310 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c74e9eaa-1fd2-4439-8d12-79701793c78d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:44.030644 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-15b8cacd-2e38-4bb3-8578-6d6bd1f39d71 req-6bb88684-5aba-4eb6-b9a9-2bc7fd9a8d66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caefb81a-86e7-4a4c-a2da-facc23b171a0", "tag": "19d9e0b4-68d1-4399-9066-18eab4717e02"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:24:44.030952 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c74e9eaa-1fd2-4439-8d12-79701793c78d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:44.037308 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=4 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:24:44.037716 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c74e9eaa-1fd2-4439-8d12-79701793c78d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:44.038204 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c74e9eaa-1fd2-4439-8d12-79701793c78d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:44.038663 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c74e9eaa-1fd2-4439-8d12-79701793c78d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:44.039361 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c74e9eaa-1fd2-4439-8d12-79701793c78d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:44.039812 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c74e9eaa-1fd2-4439-8d12-79701793c78d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:44.040235 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c74e9eaa-1fd2-4439-8d12-79701793c78d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:44.041666 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-15b8cacd-2e38-4bb3-8578-6d6bd1f39d71 req-6bb88684-5aba-4eb6-b9a9-2bc7fd9a8d66 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:44.042217 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-15b8cacd-2e38-4bb3-8578-6d6bd1f39d71 req-6bb88684-5aba-4eb6-b9a9-2bc7fd9a8d66 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:44.042752 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-15b8cacd-2e38-4bb3-8578-6d6bd1f39d71 req-6bb88684-5aba-4eb6-b9a9-2bc7fd9a8d66 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:44.055056 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-15b8cacd-2e38-4bb3-8578-6d6bd1f39d71 req-6bb88684-5aba-4eb6-b9a9-2bc7fd9a8d66 service nova] Creating event network-changed:19d9e0b4-68d1-4399-9066-18eab4717e02 for instance caefb81a-86e7-4a4c-a2da-facc23b171a0 on hv-cinder-85272 Aug 10 17:24:44.061783 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-15b8cacd-2e38-4bb3-8578-6d6bd1f39d71 req-6bb88684-5aba-4eb6-b9a9-2bc7fd9a8d66 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033924 Aug 10 17:24:44.063044 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 553/1092] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:24:44.199560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c74e9eaa-1fd2-4439-8d12-79701793c78d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:44.208569 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c74e9eaa-1fd2-4439-8d12-79701793c78d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1758 microversion: 2.1 time: 0.182156 Aug 10 17:24:44.209154 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 540/1093] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:44 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:45.015605 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3a3562fb-091c-4d51-9074-5d9cac6d0eac tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:45.017037 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3a3562fb-091c-4d51-9074-5d9cac6d0eac tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:45.019514 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=8 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:24:45.025064 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a3562fb-091c-4d51-9074-5d9cac6d0eac tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:45.025513 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a3562fb-091c-4d51-9074-5d9cac6d0eac tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:45.033506 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a3562fb-091c-4d51-9074-5d9cac6d0eac tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:45.033506 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a3562fb-091c-4d51-9074-5d9cac6d0eac tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:45.033506 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a3562fb-091c-4d51-9074-5d9cac6d0eac tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:45.033506 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a3562fb-091c-4d51-9074-5d9cac6d0eac tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:45.163324 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3a3562fb-091c-4d51-9074-5d9cac6d0eac tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:45.170778 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3a3562fb-091c-4d51-9074-5d9cac6d0eac tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1319 microversion: 2.1 time: 0.159340 Aug 10 17:24:45.171455 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 554/1094] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:45 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:46.191814 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0b58a374-6df1-46da-aaa5-549cdf88cb0f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:24:46.192514 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0b58a374-6df1-46da-aaa5-549cdf88cb0f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:46.199190 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b58a374-6df1-46da-aaa5-549cdf88cb0f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:46.199670 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b58a374-6df1-46da-aaa5-549cdf88cb0f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:46.200105 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b58a374-6df1-46da-aaa5-549cdf88cb0f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:46.200791 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b58a374-6df1-46da-aaa5-549cdf88cb0f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:46.201241 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b58a374-6df1-46da-aaa5-549cdf88cb0f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:46.201659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b58a374-6df1-46da-aaa5-549cdf88cb0f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:46.332919 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0b58a374-6df1-46da-aaa5-549cdf88cb0f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:24:46.340411 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0b58a374-6df1-46da-aaa5-549cdf88cb0f tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1508 microversion: 2.1 time: 0.152533 Aug 10 17:24:46.340977 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 541/1095] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:24:46 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:24:46.361425 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0119bae2-554f-4d48-bc80-c027d5e6b470 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a518360-dd97-424c-8fed-7d9cc91e4d59", "device": "/dev/sdb"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:24:46.363794 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0119bae2-554f-4d48-bc80-c027d5e6b470 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:24:46.369709 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0119bae2-554f-4d48-bc80-c027d5e6b470 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:46.373903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0119bae2-554f-4d48-bc80-c027d5e6b470 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:46.373903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0119bae2-554f-4d48-bc80-c027d5e6b470 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:46.373903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0119bae2-554f-4d48-bc80-c027d5e6b470 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:24:46.373903 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0119bae2-554f-4d48-bc80-c027d5e6b470 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:24:46.374339 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0119bae2-554f-4d48-bc80-c027d5e6b470 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:24:47.148719 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0119bae2-554f-4d48-bc80-c027d5e6b470 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "POST /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.791292 Aug 10 17:24:47.149392 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 555/1096] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 17:24:46 2022] POST /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d/os-volume_attachments => generated 194 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:25:08.333136 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-454a291d-133b-4797-97ec-e38eb486e8a0 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:08.333663 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-454a291d-133b-4797-97ec-e38eb486e8a0 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:08.336299 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=25 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:25:08.336969 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:25:08.341964 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-454a291d-133b-4797-97ec-e38eb486e8a0 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:08.342630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-454a291d-133b-4797-97ec-e38eb486e8a0 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:08.343072 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-454a291d-133b-4797-97ec-e38eb486e8a0 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:08.343772 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-454a291d-133b-4797-97ec-e38eb486e8a0 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:08.344230 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-454a291d-133b-4797-97ec-e38eb486e8a0 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:08.344725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-454a291d-133b-4797-97ec-e38eb486e8a0 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:08.425768 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-454a291d-133b-4797-97ec-e38eb486e8a0 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lazy-loading 'services' on Instance uuid 6259fafc-cdda-4758-b14b-f31c513d5c7d {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:25:08.642624 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-454a291d-133b-4797-97ec-e38eb486e8a0 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d/os-volume_attachments/4a518360-dd97-424c-8fed-7d9cc91e4d59" status: 202 len: 0 microversion: 2.1 time: 0.313122 Aug 10 17:25:08.643240 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 542/1097] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 17:25:08 2022] DELETE /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d/os-volume_attachments/4a518360-dd97-424c-8fed-7d9cc91e4d59 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:25:10.818993 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:25:10.820324 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:25:10.824461 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-995dff43-3a62-4710-b30a-83d090756a13 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:10.825073 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-995dff43-3a62-4710-b30a-83d090756a13 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:10.831138 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-995dff43-3a62-4710-b30a-83d090756a13 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:10.831630 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-995dff43-3a62-4710-b30a-83d090756a13 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:10.835559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-995dff43-3a62-4710-b30a-83d090756a13 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:10.835559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-995dff43-3a62-4710-b30a-83d090756a13 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:10.835559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-995dff43-3a62-4710-b30a-83d090756a13 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:10.835559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-995dff43-3a62-4710-b30a-83d090756a13 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:10.863692 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-995dff43-3a62-4710-b30a-83d090756a13 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:25:11.173047 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-995dff43-3a62-4710-b30a-83d090756a13 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 204 len: 0 microversion: 2.1 time: 0.355301 Aug 10 17:25:11.173752 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 556/1098] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:25:10 2022] DELETE /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:25:11.184089 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-da6280d0-45dc-421a-89a4-1dfca832ca1e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:11.184827 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-da6280d0-45dc-421a-89a4-1dfca832ca1e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:11.191363 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da6280d0-45dc-421a-89a4-1dfca832ca1e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:11.191860 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da6280d0-45dc-421a-89a4-1dfca832ca1e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:11.192314 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da6280d0-45dc-421a-89a4-1dfca832ca1e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:11.193041 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da6280d0-45dc-421a-89a4-1dfca832ca1e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:11.193478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da6280d0-45dc-421a-89a4-1dfca832ca1e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:11.193908 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da6280d0-45dc-421a-89a4-1dfca832ca1e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:11.331876 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-da6280d0-45dc-421a-89a4-1dfca832ca1e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:11.340044 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-da6280d0-45dc-421a-89a4-1dfca832ca1e tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1514 microversion: 2.1 time: 0.161833 Aug 10 17:25:11.340599 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 543/1099] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:11 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:12.361399 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4ecd9694-94f3-40f9-b0cb-e178acf15551 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:12.362096 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4ecd9694-94f3-40f9-b0cb-e178acf15551 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:12.368587 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ecd9694-94f3-40f9-b0cb-e178acf15551 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:12.369059 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ecd9694-94f3-40f9-b0cb-e178acf15551 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:12.369504 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ecd9694-94f3-40f9-b0cb-e178acf15551 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:12.370201 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ecd9694-94f3-40f9-b0cb-e178acf15551 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:12.370691 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ecd9694-94f3-40f9-b0cb-e178acf15551 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:12.371142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ecd9694-94f3-40f9-b0cb-e178acf15551 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:12.508375 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4ecd9694-94f3-40f9-b0cb-e178acf15551 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:12.515973 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4ecd9694-94f3-40f9-b0cb-e178acf15551 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1514 microversion: 2.1 time: 0.159037 Aug 10 17:25:12.516535 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 557/1100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:12 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:13.333512 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a38fa054-966d-45d6-999c-4b74ea0239b3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:25:13.335939 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a38fa054-966d-45d6-999c-4b74ea0239b3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:13.343494 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a38fa054-966d-45d6-999c-4b74ea0239b3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:13.344017 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a38fa054-966d-45d6-999c-4b74ea0239b3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:13.344457 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a38fa054-966d-45d6-999c-4b74ea0239b3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:13.345176 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a38fa054-966d-45d6-999c-4b74ea0239b3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:13.345637 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a38fa054-966d-45d6-999c-4b74ea0239b3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:13.346066 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a38fa054-966d-45d6-999c-4b74ea0239b3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:13.537038 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-48f08283-773c-4f2a-bac9-9751482cce73 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:13.537654 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-48f08283-773c-4f2a-bac9-9751482cce73 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:13.544905 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48f08283-773c-4f2a-bac9-9751482cce73 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:13.545415 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48f08283-773c-4f2a-bac9-9751482cce73 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:13.545861 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48f08283-773c-4f2a-bac9-9751482cce73 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:13.546634 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48f08283-773c-4f2a-bac9-9751482cce73 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:13.547127 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48f08283-773c-4f2a-bac9-9751482cce73 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:13.547605 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48f08283-773c-4f2a-bac9-9751482cce73 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:13.622082 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a38fa054-966d-45d6-999c-4b74ea0239b3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "POST /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/action" status: 202 len: 0 microversion: 2.1 time: 0.291797 Aug 10 17:25:13.623158 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 544/1101] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:25:13 2022] POST /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:25:13.631839 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f6080b01-ad1f-4962-987f-a04d60d54e26 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:13.632648 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f6080b01-ad1f-4962-987f-a04d60d54e26 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:13.639743 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6080b01-ad1f-4962-987f-a04d60d54e26 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:13.640250 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6080b01-ad1f-4962-987f-a04d60d54e26 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:13.640694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6080b01-ad1f-4962-987f-a04d60d54e26 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:13.641406 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6080b01-ad1f-4962-987f-a04d60d54e26 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:13.641870 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6080b01-ad1f-4962-987f-a04d60d54e26 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:13.642302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6080b01-ad1f-4962-987f-a04d60d54e26 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:13.706279 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-48f08283-773c-4f2a-bac9-9751482cce73 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:13.714384 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-48f08283-773c-4f2a-bac9-9751482cce73 tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1514 microversion: 2.1 time: 0.181177 Aug 10 17:25:13.716026 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 558/1102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:13 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:25:13.818403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f6080b01-ad1f-4962-987f-a04d60d54e26 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:13.827497 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f6080b01-ad1f-4962-987f-a04d60d54e26 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1750 microversion: 2.1 time: 0.200000 Aug 10 17:25:13.841048 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 545/1103] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:13 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1750 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:14.338855 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-33ed2e30-c844-4b05-8ce4-97dcbc360a2d req-4a9f3f43-779c-4ddb-ae6d-bf77d041c9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6259fafc-cdda-4758-b14b-f31c513d5c7d", "name": "network-vif-deleted", "tag": "87408352-381c-4a01-9849-34e6eb3a110f"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:25:14.349439 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-33ed2e30-c844-4b05-8ce4-97dcbc360a2d req-4a9f3f43-779c-4ddb-ae6d-bf77d041c9e1 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:14.349928 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-33ed2e30-c844-4b05-8ce4-97dcbc360a2d req-4a9f3f43-779c-4ddb-ae6d-bf77d041c9e1 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:14.350397 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-33ed2e30-c844-4b05-8ce4-97dcbc360a2d req-4a9f3f43-779c-4ddb-ae6d-bf77d041c9e1 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:14.362619 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-33ed2e30-c844-4b05-8ce4-97dcbc360a2d req-4a9f3f43-779c-4ddb-ae6d-bf77d041c9e1 service nova] Creating event network-vif-deleted:87408352-381c-4a01-9849-34e6eb3a110f for instance 6259fafc-cdda-4758-b14b-f31c513d5c7d on hv-cinder-85272 Aug 10 17:25:14.368629 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-33ed2e30-c844-4b05-8ce4-97dcbc360a2d req-4a9f3f43-779c-4ddb-ae6d-bf77d041c9e1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092929 Aug 10 17:25:14.369256 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 559/1104] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:25:14.736770 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-33e7affe-0b7a-49b5-8321-f33bfc301b8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:14.737383 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-33e7affe-0b7a-49b5-8321-f33bfc301b8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:14.743942 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e7affe-0b7a-49b5-8321-f33bfc301b8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:14.744697 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e7affe-0b7a-49b5-8321-f33bfc301b8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:14.745304 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e7affe-0b7a-49b5-8321-f33bfc301b8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:14.746256 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e7affe-0b7a-49b5-8321-f33bfc301b8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:14.746711 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e7affe-0b7a-49b5-8321-f33bfc301b8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:14.747259 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e7affe-0b7a-49b5-8321-f33bfc301b8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:14.784335 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e7affe-0b7a-49b5-8321-f33bfc301b8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:14.785387 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e7affe-0b7a-49b5-8321-f33bfc301b8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:14.785852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e7affe-0b7a-49b5-8321-f33bfc301b8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:14.786312 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-33e7affe-0b7a-49b5-8321-f33bfc301b8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lazy-loading 'fault' on Instance uuid 6259fafc-cdda-4758-b14b-f31c513d5c7d {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:25:14.831055 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-33e7affe-0b7a-49b5-8321-f33bfc301b8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d26ea8e26466f91b1905aa1e2e156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6fc2c18d44b8a8b82307021355fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:14.839716 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-33e7affe-0b7a-49b5-8321-f33bfc301b8b tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 200 len: 1309 microversion: 2.1 time: 0.106996 Aug 10 17:25:14.840957 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 546/1105] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:14 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:14.849828 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0e60a544-64e1-4a38-924d-efadaac2017d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:14.851144 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0e60a544-64e1-4a38-924d-efadaac2017d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:14.857556 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e60a544-64e1-4a38-924d-efadaac2017d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:14.858122 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e60a544-64e1-4a38-924d-efadaac2017d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:14.858786 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e60a544-64e1-4a38-924d-efadaac2017d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:14.859554 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e60a544-64e1-4a38-924d-efadaac2017d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:14.860175 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e60a544-64e1-4a38-924d-efadaac2017d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:14.860772 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e60a544-64e1-4a38-924d-efadaac2017d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:15.009732 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0e60a544-64e1-4a38-924d-efadaac2017d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:15.018715 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0e60a544-64e1-4a38-924d-efadaac2017d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1755 microversion: 2.1 time: 0.173954 Aug 10 17:25:15.019293 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 560/1106] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:14 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:15.863584 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-76fd3265-65ae-4704-8978-49dbb372147a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:15.864199 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-76fd3265-65ae-4704-8978-49dbb372147a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] [instance: 6259fafc-cdda-4758-b14b-f31c513d5c7d] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:15.870700 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76fd3265-65ae-4704-8978-49dbb372147a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:15.871182 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76fd3265-65ae-4704-8978-49dbb372147a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:15.872167 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76fd3265-65ae-4704-8978-49dbb372147a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:15.872816 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76fd3265-65ae-4704-8978-49dbb372147a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:15.873270 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76fd3265-65ae-4704-8978-49dbb372147a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:15.873685 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76fd3265-65ae-4704-8978-49dbb372147a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:15.888454 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-76fd3265-65ae-4704-8978-49dbb372147a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] HTTP exception thrown: Instance 6259fafc-cdda-4758-b14b-f31c513d5c7d could not be found. Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-76fd3265-65ae-4704-8978-49dbb372147a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Request method failure captured: Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d HTTP/1.1 Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Connection: close Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Host: 10.222.0.45 Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi8-l268e5eO98ni4FcNstzf9fTMyyTIo9OZWFpfrj98Ovg9l47SA7mHHQJLQWQcwoyLyIKSUeFnAIBbkAhFkZNWh7hDSXBMyGhTqTiCWJFnrPaSwO5YbVyHR8VBxHygY3s6hObDIY7BHOqAj9WIbdcGbgSfa8qtits2raBvziirKhqho Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Id: a49a6fc2c18d44b8a8b82307021355fd Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesSnapshotTestJSON-275177936 Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 10 17:25:15.890114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 10 17:25:15.891941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a49a6fc2c18d44b8a8b82307021355fd", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a49a6fc2c18d44b8a8b82307021355fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a49a6fc2c18d44b8a8b82307021355fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a49a6fc2c18d44b8a8b82307021355fd"}]}] Aug 10 17:25:15.891941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesSnapshotTestJSON-275177936 Aug 10 17:25:15.891941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Id: a49a6fc2c18d44b8a8b82307021355fd Aug 10 17:25:15.891941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-275177936 Aug 10 17:25:15.891941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesSnapshotTestJSON-275177936-project Aug 10 17:25:15.891941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 10 17:25:15.891941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 10 17:25:15.891941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Id: 0d7d26ea8e26466f91b1905aa1e2e156 Aug 10 17:25:15.891941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesSnapshotTestJSON-275177936-project Aug 10 17:25:15.891941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: method: > Aug 10 17:25:15.891941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: exception: Instance 6259fafc-cdda-4758-b14b-f31c513d5c7d could not be found. Aug 10 17:25:15.891941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: action_args: {'id': '6259fafc-cdda-4758-b14b-f31c513d5c7d'} Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6259fafc-cdda-4758-b14b-f31c513d5c7d could not be found. Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:25:15.892902 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6259fafc-cdda-4758-b14b-f31c513d5c7d could not be found. Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6259fafc-cdda-4758-b14b-f31c513d5c7d could not be found. Aug 10 17:25:15.894784 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 10 17:25:15.896635 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-76fd3265-65ae-4704-8978-49dbb372147a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] Returning 404 to user: Instance 6259fafc-cdda-4758-b14b-f31c513d5c7d could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:25:15.896635 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-76fd3265-65ae-4704-8978-49dbb372147a tempest-VolumesSnapshotTestJSON-275177936 tempest-VolumesSnapshotTestJSON-275177936-project] 10.222.0.45 "GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d" status: 404 len: 111 microversion: 2.1 time: 0.031878 Aug 10 17:25:15.896635 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 547/1107] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:15 2022] GET /compute/v2.1/servers/6259fafc-cdda-4758-b14b-f31c513d5c7d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:25:16.040053 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f3ab4ccc-6f36-4876-ac81-cb185ff4e527 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:16.040665 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f3ab4ccc-6f36-4876-ac81-cb185ff4e527 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:16.047974 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3ab4ccc-6f36-4876-ac81-cb185ff4e527 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:16.048465 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3ab4ccc-6f36-4876-ac81-cb185ff4e527 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:16.048907 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3ab4ccc-6f36-4876-ac81-cb185ff4e527 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:16.049668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3ab4ccc-6f36-4876-ac81-cb185ff4e527 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:16.050127 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3ab4ccc-6f36-4876-ac81-cb185ff4e527 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:16.050658 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3ab4ccc-6f36-4876-ac81-cb185ff4e527 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:16.200119 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f3ab4ccc-6f36-4876-ac81-cb185ff4e527 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:16.209844 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f3ab4ccc-6f36-4876-ac81-cb185ff4e527 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1755 microversion: 2.1 time: 0.173584 Aug 10 17:25:16.210493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 561/1108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:16 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:17.235315 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-68090529-e88b-419a-816c-050fad417edf tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:17.235895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-68090529-e88b-419a-816c-050fad417edf tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:17.242188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-68090529-e88b-419a-816c-050fad417edf tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:17.242700 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-68090529-e88b-419a-816c-050fad417edf tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:17.243140 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-68090529-e88b-419a-816c-050fad417edf tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:17.243826 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-68090529-e88b-419a-816c-050fad417edf tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:17.244277 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-68090529-e88b-419a-816c-050fad417edf tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:17.244699 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-68090529-e88b-419a-816c-050fad417edf tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:17.389699 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-68090529-e88b-419a-816c-050fad417edf tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:17.397649 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-68090529-e88b-419a-816c-050fad417edf tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1755 microversion: 2.1 time: 0.167212 Aug 10 17:25:17.398206 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 548/1109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:17 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:18.420074 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e3b3cfd0-c29e-4832-ba06-11d0301eba7b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:18.420680 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e3b3cfd0-c29e-4832-ba06-11d0301eba7b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:18.427125 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3b3cfd0-c29e-4832-ba06-11d0301eba7b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:18.427604 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3b3cfd0-c29e-4832-ba06-11d0301eba7b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:18.428038 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3b3cfd0-c29e-4832-ba06-11d0301eba7b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:18.428735 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3b3cfd0-c29e-4832-ba06-11d0301eba7b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:18.429184 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3b3cfd0-c29e-4832-ba06-11d0301eba7b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:18.429606 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3b3cfd0-c29e-4832-ba06-11d0301eba7b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:18.584769 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e3b3cfd0-c29e-4832-ba06-11d0301eba7b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:18.592888 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e3b3cfd0-c29e-4832-ba06-11d0301eba7b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1755 microversion: 2.1 time: 0.176783 Aug 10 17:25:18.593508 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 562/1110] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:18 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:19.614688 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1a7b1dcc-02f4-4b4c-8dbc-a8f5b0000565 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:19.615299 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1a7b1dcc-02f4-4b4c-8dbc-a8f5b0000565 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:19.622367 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a7b1dcc-02f4-4b4c-8dbc-a8f5b0000565 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:19.622860 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a7b1dcc-02f4-4b4c-8dbc-a8f5b0000565 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:19.623294 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a7b1dcc-02f4-4b4c-8dbc-a8f5b0000565 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:19.623982 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a7b1dcc-02f4-4b4c-8dbc-a8f5b0000565 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:19.624430 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a7b1dcc-02f4-4b4c-8dbc-a8f5b0000565 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:19.624845 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a7b1dcc-02f4-4b4c-8dbc-a8f5b0000565 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:19.771485 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1a7b1dcc-02f4-4b4c-8dbc-a8f5b0000565 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:19.780565 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1a7b1dcc-02f4-4b4c-8dbc-a8f5b0000565 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1755 microversion: 2.1 time: 0.169845 Aug 10 17:25:19.781128 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 549/1111] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:19 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:20.802205 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3ad2ea91-418a-46b8-bd5e-45292168047b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:20.802845 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3ad2ea91-418a-46b8-bd5e-45292168047b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:20.809349 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ad2ea91-418a-46b8-bd5e-45292168047b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:20.809904 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ad2ea91-418a-46b8-bd5e-45292168047b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:20.810344 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ad2ea91-418a-46b8-bd5e-45292168047b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:20.811088 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ad2ea91-418a-46b8-bd5e-45292168047b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:20.811525 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ad2ea91-418a-46b8-bd5e-45292168047b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:20.811953 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ad2ea91-418a-46b8-bd5e-45292168047b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:20.963425 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3ad2ea91-418a-46b8-bd5e-45292168047b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:20.972073 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3ad2ea91-418a-46b8-bd5e-45292168047b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1755 microversion: 2.1 time: 0.173776 Aug 10 17:25:20.974729 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 563/1112] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:20 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:21.994139 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d74b66c6-ce8e-4a16-a754-abc79516dc0f tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:21.994722 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d74b66c6-ce8e-4a16-a754-abc79516dc0f tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:22.002025 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d74b66c6-ce8e-4a16-a754-abc79516dc0f tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:22.002561 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d74b66c6-ce8e-4a16-a754-abc79516dc0f tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:22.003001 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d74b66c6-ce8e-4a16-a754-abc79516dc0f tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:22.003726 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d74b66c6-ce8e-4a16-a754-abc79516dc0f tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:22.004304 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d74b66c6-ce8e-4a16-a754-abc79516dc0f tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:22.004814 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d74b66c6-ce8e-4a16-a754-abc79516dc0f tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:22.149778 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d74b66c6-ce8e-4a16-a754-abc79516dc0f tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:22.158174 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d74b66c6-ce8e-4a16-a754-abc79516dc0f tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1755 microversion: 2.1 time: 0.168001 Aug 10 17:25:22.158777 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 550/1113] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:21 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:23.179182 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-715c9249-ccf2-4256-9f77-dcad19492cc0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:23.179810 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-715c9249-ccf2-4256-9f77-dcad19492cc0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:23.186491 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-715c9249-ccf2-4256-9f77-dcad19492cc0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:23.186988 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-715c9249-ccf2-4256-9f77-dcad19492cc0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:23.187442 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-715c9249-ccf2-4256-9f77-dcad19492cc0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:23.188145 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-715c9249-ccf2-4256-9f77-dcad19492cc0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:23.188608 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-715c9249-ccf2-4256-9f77-dcad19492cc0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:23.189039 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-715c9249-ccf2-4256-9f77-dcad19492cc0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:23.336146 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-715c9249-ccf2-4256-9f77-dcad19492cc0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:23.344301 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-715c9249-ccf2-4256-9f77-dcad19492cc0 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1755 microversion: 2.1 time: 0.169084 Aug 10 17:25:23.344866 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 564/1114] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:23 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:24.365828 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-350b8fc5-80d9-430c-9d7a-b987d5bf4cff tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:24.366634 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-350b8fc5-80d9-430c-9d7a-b987d5bf4cff tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:24.372846 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-350b8fc5-80d9-430c-9d7a-b987d5bf4cff tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:24.373955 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-350b8fc5-80d9-430c-9d7a-b987d5bf4cff tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:24.374540 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-350b8fc5-80d9-430c-9d7a-b987d5bf4cff tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:24.375242 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-350b8fc5-80d9-430c-9d7a-b987d5bf4cff tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:24.375703 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-350b8fc5-80d9-430c-9d7a-b987d5bf4cff tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:24.376199 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-350b8fc5-80d9-430c-9d7a-b987d5bf4cff tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:24.522573 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-350b8fc5-80d9-430c-9d7a-b987d5bf4cff tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:24.531439 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-350b8fc5-80d9-430c-9d7a-b987d5bf4cff tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1755 microversion: 2.1 time: 0.169929 Aug 10 17:25:24.532023 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 551/1115] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:24 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:25.552838 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a6c1d3b8-ebfc-42b8-964d-28aa276ab9a3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:25.553457 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a6c1d3b8-ebfc-42b8-964d-28aa276ab9a3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:25.559861 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6c1d3b8-ebfc-42b8-964d-28aa276ab9a3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:25.560881 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6c1d3b8-ebfc-42b8-964d-28aa276ab9a3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:25.561324 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6c1d3b8-ebfc-42b8-964d-28aa276ab9a3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:25.562016 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6c1d3b8-ebfc-42b8-964d-28aa276ab9a3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:25.562549 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6c1d3b8-ebfc-42b8-964d-28aa276ab9a3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:25.562977 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6c1d3b8-ebfc-42b8-964d-28aa276ab9a3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:25.708745 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a6c1d3b8-ebfc-42b8-964d-28aa276ab9a3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:25.716939 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a6c1d3b8-ebfc-42b8-964d-28aa276ab9a3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1755 microversion: 2.1 time: 0.168154 Aug 10 17:25:25.717519 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 565/1116] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:25 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:26.738949 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1f6f4e71-35f3-45f1-baca-83734b25aece tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:26.739598 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1f6f4e71-35f3-45f1-baca-83734b25aece tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:26.745984 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f6f4e71-35f3-45f1-baca-83734b25aece tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:26.746521 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f6f4e71-35f3-45f1-baca-83734b25aece tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:26.746969 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f6f4e71-35f3-45f1-baca-83734b25aece tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:26.751010 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f6f4e71-35f3-45f1-baca-83734b25aece tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:26.751010 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f6f4e71-35f3-45f1-baca-83734b25aece tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:26.751010 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f6f4e71-35f3-45f1-baca-83734b25aece tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:26.901318 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1f6f4e71-35f3-45f1-baca-83734b25aece tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:26.910203 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1f6f4e71-35f3-45f1-baca-83734b25aece tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1755 microversion: 2.1 time: 0.175339 Aug 10 17:25:26.910817 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 552/1117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:26 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:25:27.932372 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-571348dc-e016-4440-af7a-63a99a781b1d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:25:27.932912 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-571348dc-e016-4440-af7a-63a99a781b1d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:25:27.939457 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-571348dc-e016-4440-af7a-63a99a781b1d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:27.939947 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-571348dc-e016-4440-af7a-63a99a781b1d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:27.940384 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-571348dc-e016-4440-af7a-63a99a781b1d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:27.941084 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-571348dc-e016-4440-af7a-63a99a781b1d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:25:27.941538 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-571348dc-e016-4440-af7a-63a99a781b1d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:25:27.941965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-571348dc-e016-4440-af7a-63a99a781b1d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:25:28.087356 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-571348dc-e016-4440-af7a-63a99a781b1d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:25:28.096035 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-571348dc-e016-4440-af7a-63a99a781b1d tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1758 microversion: 2.1 time: 0.167674 Aug 10 17:25:28.096601 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 566/1118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:25:27 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:26:03.403653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6b614c10-507b-46ff-a0a7-0d707c439332 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-119128271"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:26:03.404283 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6b614c10-507b-46ff-a0a7-0d707c439332 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:26:03.406477 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=24 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:26:03.407132 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:26:03.412165 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b614c10-507b-46ff-a0a7-0d707c439332 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:03.412664 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b614c10-507b-46ff-a0a7-0d707c439332 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:03.413099 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b614c10-507b-46ff-a0a7-0d707c439332 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:03.413804 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b614c10-507b-46ff-a0a7-0d707c439332 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:03.414313 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b614c10-507b-46ff-a0a7-0d707c439332 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:03.420956 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6b614c10-507b-46ff-a0a7-0d707c439332 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:03.553485 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.network.security_group_api [None req-6b614c10-507b-46ff-a0a7-0d707c439332 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Removing security group 7a25f3f8-67fb-4e16-b1b3-65d1e1fda7c8 from port 19d9e0b4-68d1-4399-9066-18eab4717e02 Aug 10 17:26:03.941724 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6b614c10-507b-46ff-a0a7-0d707c439332 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "POST /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/action" status: 202 len: 0 microversion: 2.1 time: 0.541517 Aug 10 17:26:03.942378 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 553/1119] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:26:03 2022] POST /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:26:03.951054 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:26:03.951957 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:26:04.180849 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-0452d469-1339-4b0a-91aa-2f04b5f57bad req-b4eea8b1-febd-4cad-9bac-a9d090987b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caefb81a-86e7-4a4c-a2da-facc23b171a0", "tag": "19d9e0b4-68d1-4399-9066-18eab4717e02"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:26:04.198028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0452d469-1339-4b0a-91aa-2f04b5f57bad req-b4eea8b1-febd-4cad-9bac-a9d090987b8c service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:04.198028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0452d469-1339-4b0a-91aa-2f04b5f57bad req-b4eea8b1-febd-4cad-9bac-a9d090987b8c service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:04.198028 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0452d469-1339-4b0a-91aa-2f04b5f57bad req-b4eea8b1-febd-4cad-9bac-a9d090987b8c service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:04.206488 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-0452d469-1339-4b0a-91aa-2f04b5f57bad req-b4eea8b1-febd-4cad-9bac-a9d090987b8c service nova] Creating event network-changed:19d9e0b4-68d1-4399-9066-18eab4717e02 for instance caefb81a-86e7-4a4c-a2da-facc23b171a0 on hv-cinder-85272 Aug 10 17:26:04.214780 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-0452d469-1339-4b0a-91aa-2f04b5f57bad req-b4eea8b1-febd-4cad-9bac-a9d090987b8c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268902 Aug 10 17:26:04.216281 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 567/1120] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:26:05.151824 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e7dd3101-2307-4c1a-bd17-6572cd04e818 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:26:05.152379 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e7dd3101-2307-4c1a-bd17-6572cd04e818 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:26:05.158242 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7dd3101-2307-4c1a-bd17-6572cd04e818 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:05.158769 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7dd3101-2307-4c1a-bd17-6572cd04e818 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:05.159209 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7dd3101-2307-4c1a-bd17-6572cd04e818 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:05.159960 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7dd3101-2307-4c1a-bd17-6572cd04e818 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:05.160426 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7dd3101-2307-4c1a-bd17-6572cd04e818 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:05.160974 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7dd3101-2307-4c1a-bd17-6572cd04e818 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:05.244780 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-e7dd3101-2307-4c1a-bd17-6572cd04e818 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lazy-loading 'services' on Instance uuid caefb81a-86e7-4a4c-a2da-facc23b171a0 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:26:05.520379 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e7dd3101-2307-4c1a-bd17-6572cd04e818 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "DELETE /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/os-volume_attachments/59dc0d2b-bf42-4153-9319-9c5b05ccadba" status: 202 len: 0 microversion: 2.1 time: 0.372648 Aug 10 17:26:05.521247 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 554/1121] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 17:26:05 2022] DELETE /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/os-volume_attachments/59dc0d2b-bf42-4153-9319-9c5b05ccadba => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:26:05.530780 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-06829733-6052-43ca-bd2d-5ce0ad0f152b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:26:05.533019 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-06829733-6052-43ca-bd2d-5ce0ad0f152b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:26:05.540760 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06829733-6052-43ca-bd2d-5ce0ad0f152b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:05.541176 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06829733-6052-43ca-bd2d-5ce0ad0f152b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:05.541617 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06829733-6052-43ca-bd2d-5ce0ad0f152b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:05.542331 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06829733-6052-43ca-bd2d-5ce0ad0f152b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:05.542818 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06829733-6052-43ca-bd2d-5ce0ad0f152b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:05.543248 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06829733-6052-43ca-bd2d-5ce0ad0f152b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:05.577046 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-06829733-6052-43ca-bd2d-5ce0ad0f152b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051127 Aug 10 17:26:05.577778 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 568/1122] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:26:05 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:26:06.275488 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-ce409482-ff4f-4924-b668-fc2d2f664c6d req-21320f32-476c-4c01-b058-d960524226ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caefb81a-86e7-4a4c-a2da-facc23b171a0", "tag": "19d9e0b4-68d1-4399-9066-18eab4717e02"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:26:06.286910 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-ce409482-ff4f-4924-b668-fc2d2f664c6d req-21320f32-476c-4c01-b058-d960524226ed service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:06.287403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-ce409482-ff4f-4924-b668-fc2d2f664c6d req-21320f32-476c-4c01-b058-d960524226ed service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:06.290160 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-ce409482-ff4f-4924-b668-fc2d2f664c6d req-21320f32-476c-4c01-b058-d960524226ed service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:06.299684 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-ce409482-ff4f-4924-b668-fc2d2f664c6d req-21320f32-476c-4c01-b058-d960524226ed service nova] Creating event network-changed:19d9e0b4-68d1-4399-9066-18eab4717e02 for instance caefb81a-86e7-4a4c-a2da-facc23b171a0 on hv-cinder-85272 Aug 10 17:26:06.305299 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-ce409482-ff4f-4924-b668-fc2d2f664c6d req-21320f32-476c-4c01-b058-d960524226ed service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035481 Aug 10 17:26:06.305908 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 555/1123] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:26:06.594920 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c09d8750-f972-4024-b163-d9221867dce8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:26:06.597938 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c09d8750-f972-4024-b163-d9221867dce8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:26:06.606270 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c09d8750-f972-4024-b163-d9221867dce8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:06.607131 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c09d8750-f972-4024-b163-d9221867dce8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:06.607732 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c09d8750-f972-4024-b163-d9221867dce8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:06.608689 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c09d8750-f972-4024-b163-d9221867dce8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:06.609326 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c09d8750-f972-4024-b163-d9221867dce8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:06.609931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c09d8750-f972-4024-b163-d9221867dce8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:06.651493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c09d8750-f972-4024-b163-d9221867dce8 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063377 Aug 10 17:26:06.652539 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 569/1124] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:26:06 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:26:07.665438 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f97b20d0-1519-4ebb-a7a3-2ef6ab964fea tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:26:07.667803 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f97b20d0-1519-4ebb-a7a3-2ef6ab964fea tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:26:07.674234 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f97b20d0-1519-4ebb-a7a3-2ef6ab964fea tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:07.674755 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f97b20d0-1519-4ebb-a7a3-2ef6ab964fea tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:07.675193 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f97b20d0-1519-4ebb-a7a3-2ef6ab964fea tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:07.676631 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f97b20d0-1519-4ebb-a7a3-2ef6ab964fea tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:07.677092 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f97b20d0-1519-4ebb-a7a3-2ef6ab964fea tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:07.677519 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f97b20d0-1519-4ebb-a7a3-2ef6ab964fea tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:07.708209 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f97b20d0-1519-4ebb-a7a3-2ef6ab964fea tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048167 Aug 10 17:26:07.708818 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 556/1125] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 17:26:07 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 17:26:07.719827 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f718a920-6144-475b-a65d-a4080d0925a6 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:26:07.720334 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f718a920-6144-475b-a65d-a4080d0925a6 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:26:07.727156 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f718a920-6144-475b-a65d-a4080d0925a6 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:07.727644 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f718a920-6144-475b-a65d-a4080d0925a6 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:07.728087 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f718a920-6144-475b-a65d-a4080d0925a6 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:07.728794 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f718a920-6144-475b-a65d-a4080d0925a6 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:07.729252 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f718a920-6144-475b-a65d-a4080d0925a6 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:07.729693 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f718a920-6144-475b-a65d-a4080d0925a6 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:07.807579 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-f718a920-6144-475b-a65d-a4080d0925a6 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] HTTP exception thrown: Instance caefb81a-86e7-4a4c-a2da-facc23b171a0 is not attached to volume 59dc0d2b-bf42-4153-9319-9c5b05ccadba Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f718a920-6144-475b-a65d-a4080d0925a6 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Request method failure captured: Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/os-volume_attachments/59dc0d2b-bf42-4153-9319-9c5b05ccadba HTTP/1.1 Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-mZndnsSUjM5I-QBmKV4OfCyjmOU50TtR_HF-GRkEc-FOzMhbOZH6B5gAK2Xtzn0doUwb8Fwn5mZuTFGGLF8tAj0E-Ja_Zotq1v-VJmLytzl4XZEliJqQcAYq3TGHw70st1wkTmNHqJOXmu4Etg-CmHh9aFdJC-VduUTHzYrgyIJVQ Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: 0ca8a0c2eb86470cb9e609f05e4ceee7 Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-TestMinimumBasicScenario-756552859 Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:26:07.817900 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:26:07.819711 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0ca8a0c2eb86470cb9e609f05e4ceee7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0ca8a0c2eb86470cb9e609f05e4ceee7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0ca8a0c2eb86470cb9e609f05e4ceee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0ca8a0c2eb86470cb9e609f05e4ceee7"}]}] Aug 10 17:26:07.819711 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-TestMinimumBasicScenario-756552859 Aug 10 17:26:07.819711 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 0ca8a0c2eb86470cb9e609f05e4ceee7 Aug 10 17:26:07.819711 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-TestMinimumBasicScenario-756552859 Aug 10 17:26:07.819711 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-TestMinimumBasicScenario-756552859-project Aug 10 17:26:07.819711 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:26:07.819711 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:26:07.819711 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: dd1ac5036e16409a9a5cac62fed7d7e7 Aug 10 17:26:07.819711 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-TestMinimumBasicScenario-756552859-project Aug 10 17:26:07.819711 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:26:07.819711 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance caefb81a-86e7-4a4c-a2da-facc23b171a0 is not attached to volume 59dc0d2b-bf42-4153-9319-9c5b05ccadba Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'server_id': 'caefb81a-86e7-4a4c-a2da-facc23b171a0', 'id': '59dc0d2b-bf42-4153-9319-9c5b05ccadba'} Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 59dc0d2b-bf42-4153-9319-9c5b05ccadba. Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:26:07.820555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caefb81a-86e7-4a4c-a2da-facc23b171a0 is not attached to volume 59dc0d2b-bf42-4153-9319-9c5b05ccadba Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caefb81a-86e7-4a4c-a2da-facc23b171a0 is not attached to volume 59dc0d2b-bf42-4153-9319-9c5b05ccadba Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:26:07.821965 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f718a920-6144-475b-a65d-a4080d0925a6 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Returning 404 to user: Instance caefb81a-86e7-4a4c-a2da-facc23b171a0 is not attached to volume 59dc0d2b-bf42-4153-9319-9c5b05ccadba {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:26:07.823227 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f718a920-6144-475b-a65d-a4080d0925a6 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "DELETE /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/os-volume_attachments/59dc0d2b-bf42-4153-9319-9c5b05ccadba" status: 404 len: 154 microversion: 2.1 time: 0.104627 Aug 10 17:26:07.823227 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 570/1126] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 17:26:07 2022] DELETE /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0/os-volume_attachments/59dc0d2b-bf42-4153-9319-9c5b05ccadba => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:26:09.100214 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6f230db2-693a-4fcd-86f2-61e3b982e028 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:26:09.100770 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6f230db2-693a-4fcd-86f2-61e3b982e028 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:26:09.107542 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6f230db2-693a-4fcd-86f2-61e3b982e028 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:09.108043 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6f230db2-693a-4fcd-86f2-61e3b982e028 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:09.108633 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6f230db2-693a-4fcd-86f2-61e3b982e028 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:09.109356 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6f230db2-693a-4fcd-86f2-61e3b982e028 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:09.109880 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6f230db2-693a-4fcd-86f2-61e3b982e028 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:09.110317 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6f230db2-693a-4fcd-86f2-61e3b982e028 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:09.138019 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6f230db2-693a-4fcd-86f2-61e3b982e028 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:26:09.509026 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6f230db2-693a-4fcd-86f2-61e3b982e028 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "DELETE /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 204 len: 0 microversion: 2.1 time: 0.412719 Aug 10 17:26:09.509617 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 557/1127] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:26:09 2022] DELETE /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:26:09.517790 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c2cb3a20-d72f-42ee-88b5-ec42fd1c2b08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:26:09.518827 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c2cb3a20-d72f-42ee-88b5-ec42fd1c2b08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:26:09.525654 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2cb3a20-d72f-42ee-88b5-ec42fd1c2b08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:09.526145 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2cb3a20-d72f-42ee-88b5-ec42fd1c2b08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:09.526620 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2cb3a20-d72f-42ee-88b5-ec42fd1c2b08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:09.527323 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2cb3a20-d72f-42ee-88b5-ec42fd1c2b08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:09.527782 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2cb3a20-d72f-42ee-88b5-ec42fd1c2b08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:09.528213 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2cb3a20-d72f-42ee-88b5-ec42fd1c2b08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:09.664857 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c2cb3a20-d72f-42ee-88b5-ec42fd1c2b08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:26:09.673029 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c2cb3a20-d72f-42ee-88b5-ec42fd1c2b08 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1554 microversion: 2.1 time: 0.158958 Aug 10 17:26:09.673651 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 571/1128] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:26:09 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:26:10.695441 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-50a05b7b-c494-4cc1-89bc-c5226ca347d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:26:10.696157 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-50a05b7b-c494-4cc1-89bc-c5226ca347d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:26:10.702596 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-50a05b7b-c494-4cc1-89bc-c5226ca347d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:10.703089 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-50a05b7b-c494-4cc1-89bc-c5226ca347d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:10.703529 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-50a05b7b-c494-4cc1-89bc-c5226ca347d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:10.704228 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-50a05b7b-c494-4cc1-89bc-c5226ca347d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:10.704687 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-50a05b7b-c494-4cc1-89bc-c5226ca347d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:10.705114 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-50a05b7b-c494-4cc1-89bc-c5226ca347d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:10.838336 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-50a05b7b-c494-4cc1-89bc-c5226ca347d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:26:10.845967 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-50a05b7b-c494-4cc1-89bc-c5226ca347d3 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1554 microversion: 2.1 time: 0.155374 Aug 10 17:26:10.846531 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 558/1129] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:26:10 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:26:11.866632 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4009300c-fde4-4bd3-af56-74f4a2f8f761 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:26:11.867328 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4009300c-fde4-4bd3-af56-74f4a2f8f761 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:26:11.873568 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4009300c-fde4-4bd3-af56-74f4a2f8f761 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:11.878574 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4009300c-fde4-4bd3-af56-74f4a2f8f761 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:11.878574 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4009300c-fde4-4bd3-af56-74f4a2f8f761 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:11.878574 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4009300c-fde4-4bd3-af56-74f4a2f8f761 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:11.878574 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4009300c-fde4-4bd3-af56-74f4a2f8f761 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:11.879185 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4009300c-fde4-4bd3-af56-74f4a2f8f761 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:11.895144 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:26:11.901727 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Wed Aug 10 17:26:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 (ip 10.222.0.45) !!! Aug 10 17:26:11.950575 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4009300c-fde4-4bd3-af56-74f4a2f8f761 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1ac5036e16409a9a5cac62fed7d7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca8a0c2eb86470cb9e609f05e4ceee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:26:11.964550 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4009300c-fde4-4bd3-af56-74f4a2f8f761 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 200 len: 1512 microversion: 2.1 time: 0.101874 Aug 10 17:26:11.965718 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 572/1130] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:26:11 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 1512 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:26:12.006373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-dac77c0f-be0e-42fa-b589-6c68f6c61440 req-47b45d9d-a8fb-4483-a244-cb233c3f7cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caefb81a-86e7-4a4c-a2da-facc23b171a0", "name": "network-vif-deleted", "tag": "19d9e0b4-68d1-4399-9066-18eab4717e02"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:26:12.016403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-dac77c0f-be0e-42fa-b589-6c68f6c61440 req-47b45d9d-a8fb-4483-a244-cb233c3f7cd6 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:12.016920 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-dac77c0f-be0e-42fa-b589-6c68f6c61440 req-47b45d9d-a8fb-4483-a244-cb233c3f7cd6 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:12.017350 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-dac77c0f-be0e-42fa-b589-6c68f6c61440 req-47b45d9d-a8fb-4483-a244-cb233c3f7cd6 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:12.029610 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-dac77c0f-be0e-42fa-b589-6c68f6c61440 req-47b45d9d-a8fb-4483-a244-cb233c3f7cd6 service nova] Creating event network-vif-deleted:19d9e0b4-68d1-4399-9066-18eab4717e02 for instance caefb81a-86e7-4a4c-a2da-facc23b171a0 on hv-cinder-85272 Aug 10 17:26:12.034716 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-dac77c0f-be0e-42fa-b589-6c68f6c61440 req-47b45d9d-a8fb-4483-a244-cb233c3f7cd6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032795 Aug 10 17:26:12.036103 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 559/1131] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:26:12.987126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f5498196-552b-4a78-9ebe-ad4257f09029 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:26:12.987815 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f5498196-552b-4a78-9ebe-ad4257f09029 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] [instance: caefb81a-86e7-4a4c-a2da-facc23b171a0] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:26:12.994455 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5498196-552b-4a78-9ebe-ad4257f09029 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:12.994950 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5498196-552b-4a78-9ebe-ad4257f09029 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:12.995394 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5498196-552b-4a78-9ebe-ad4257f09029 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:12.996099 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5498196-552b-4a78-9ebe-ad4257f09029 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:12.996557 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5498196-552b-4a78-9ebe-ad4257f09029 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:12.996988 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5498196-552b-4a78-9ebe-ad4257f09029 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:13.011496 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-f5498196-552b-4a78-9ebe-ad4257f09029 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] HTTP exception thrown: Instance caefb81a-86e7-4a4c-a2da-facc23b171a0 could not be found. Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f5498196-552b-4a78-9ebe-ad4257f09029 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Request method failure captured: Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 HTTP/1.1 Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-mZndnsSUjM5I-QBmKV4OfCyjmOU50TtR_HF-GRkEc-FOzMhbOZH6B5gAK2Xtzn0doUwb8Fwn5mZuTFGGLF8tAj0E-Ja_Zotq1v-VJmLytzl4XZEliJqQcAYq3TGHw70st1wkTmNHqJOXmu4Etg-CmHh9aFdJC-VduUTHzYrgyIJVQ Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: 0ca8a0c2eb86470cb9e609f05e4ceee7 Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-TestMinimumBasicScenario-756552859 Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:26:13.013040 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:26:13.014756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0ca8a0c2eb86470cb9e609f05e4ceee7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0ca8a0c2eb86470cb9e609f05e4ceee7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0ca8a0c2eb86470cb9e609f05e4ceee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0ca8a0c2eb86470cb9e609f05e4ceee7"}]}] Aug 10 17:26:13.014756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-TestMinimumBasicScenario-756552859 Aug 10 17:26:13.014756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 0ca8a0c2eb86470cb9e609f05e4ceee7 Aug 10 17:26:13.014756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-TestMinimumBasicScenario-756552859 Aug 10 17:26:13.014756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-TestMinimumBasicScenario-756552859-project Aug 10 17:26:13.014756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:26:13.014756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:26:13.014756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: dd1ac5036e16409a9a5cac62fed7d7e7 Aug 10 17:26:13.014756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-TestMinimumBasicScenario-756552859-project Aug 10 17:26:13.014756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:26:13.014756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance caefb81a-86e7-4a4c-a2da-facc23b171a0 could not be found. Aug 10 17:26:13.014756 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': 'caefb81a-86e7-4a4c-a2da-facc23b171a0'} Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caefb81a-86e7-4a4c-a2da-facc23b171a0 could not be found. Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:26:13.015668 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caefb81a-86e7-4a4c-a2da-facc23b171a0 could not be found. Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caefb81a-86e7-4a4c-a2da-facc23b171a0 could not be found. Aug 10 17:26:13.017230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:26:13.018619 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f5498196-552b-4a78-9ebe-ad4257f09029 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Returning 404 to user: Instance caefb81a-86e7-4a4c-a2da-facc23b171a0 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:26:13.018619 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f5498196-552b-4a78-9ebe-ad4257f09029 tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0" status: 404 len: 111 microversion: 2.1 time: 0.031289 Aug 10 17:26:13.018619 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 573/1132] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:26:12 2022] GET /compute/v2.1/servers/caefb81a-86e7-4a4c-a2da-facc23b171a0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:26:13.024343 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0761cda7-5d57-4024-adb4-70f349050f0b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] Calling method '.version_select at 0x7f7eba393d30>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:26:13.104116 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0761cda7-5d57-4024-adb4-70f349050f0b tempest-TestMinimumBasicScenario-756552859 tempest-TestMinimumBasicScenario-756552859-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1469596934" status: 202 len: 0 microversion: 2.1 time: 0.084464 Aug 10 17:26:13.104694 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 560/1133] 10.222.0.45 () {58 vars in 1272 bytes} [Wed Aug 10 17:26:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1469596934 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:26:37.938056 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=14 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:26:37.939314 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=34 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:26:38.108776 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-043c629c-edf7-4404-8cee-cbb2e90a1158 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Action: 'create', calling method: .version_select at 0x7f7ebc4ad940>, body: {"keypair": {"name": "tempest-TestShelveInstance-721286479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeJEqPzUnbgXRSH2ttbXHWmF3TD6KBG6+QWKALG2DQc7D68OOMcpsQXDCaoD9NS299NxqiBpVc6sO1Evceht2PQkB/3k1zKwogPKpg2Hd0EOuuYjwAt1GB7K9Ox01mcag=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:26:38.124577 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-043c629c-edf7-4404-8cee-cbb2e90a1158 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Getting quotas for project c1f04e9a75b44271a9a2aa3834c5c9d4. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:26:38.128446 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-043c629c-edf7-4404-8cee-cbb2e90a1158 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Getting quotas for user a9736ec2b6c54177971db7277ca04c1d and project c1f04e9a75b44271a9a2aa3834c5c9d4. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:26:38.217725 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-043c629c-edf7-4404-8cee-cbb2e90a1158 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.284532 Aug 10 17:26:38.218329 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 574/1134] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 17:26:37 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:26:57.724941 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:26:57.725708 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:26:57.729812 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1259721534", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-721286479", "security_groups": [{"name": "tempest-secgroup-smoke-81181674"}], "networks": [{"uuid": "581e410a-43c1-4dec-80ff-916ddc9beae2"}], "block_device_mapping_v2": [{"uuid": "3953cad8-a8cb-405c-b0aa-c250bd46d6a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:26:57.847143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] validate_networks() for [('581e410a-43c1-4dec-80ff-916ddc9beae2', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 17:26:58.331191 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 17:26:58.331619 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 17:26:58.332095 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 17:26:58.332506 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 17:26:58.332940 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 17:26:58.342025 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:58.342549 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:58.343064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:58.343820 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:58.344277 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:58.344701 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:58.362524 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Getting quotas for project c1f04e9a75b44271a9a2aa3834c5c9d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 17:26:58.367303 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Getting quotas for user a9736ec2b6c54177971db7277ca04c1d and project c1f04e9a75b44271a9a2aa3834c5c9d4. Resources: {'ram', 'instances', 'cores'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 17:26:58.427671 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 17:26:58.429860 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3953cad8-a8cb-405c-b0aa-c250bd46d6a0',volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 17:26:58.859485 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6c4494f5-d553-4574-9a92-8f2d2458657d tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.136130 Aug 10 17:26:58.860271 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 561/1135] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 17:26:57 2022] POST /compute/v2.1/servers => generated 404 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 17:26:58.872126 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d22a2837-6fdb-470c-8939-459b177fcdb6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:26:58.872800 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d22a2837-6fdb-470c-8939-459b177fcdb6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:26:58.875285 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=4 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:26:58.875976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:26:58.933287 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d22a2837-6fdb-470c-8939-459b177fcdb6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:26:58.940446 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d22a2837-6fdb-470c-8939-459b177fcdb6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1088 microversion: 2.1 time: 0.072578 Aug 10 17:26:58.941083 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 575/1136] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:26:58 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:26:59.962687 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-33300ce0-a067-4533-8fb6-68795b7f5323 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:26:59.963307 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-33300ce0-a067-4533-8fb6-68795b7f5323 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:26:59.969958 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33300ce0-a067-4533-8fb6-68795b7f5323 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:59.970496 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33300ce0-a067-4533-8fb6-68795b7f5323 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:59.970931 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33300ce0-a067-4533-8fb6-68795b7f5323 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:26:59.971632 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33300ce0-a067-4533-8fb6-68795b7f5323 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:26:59.972086 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33300ce0-a067-4533-8fb6-68795b7f5323 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:26:59.972517 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33300ce0-a067-4533-8fb6-68795b7f5323 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:00.038220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-33300ce0-a067-4533-8fb6-68795b7f5323 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:00.045777 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-33300ce0-a067-4533-8fb6-68795b7f5323 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1138 microversion: 2.1 time: 0.087728 Aug 10 17:27:00.046344 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 562/1137] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:26:59 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:27:01.067407 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6d373478-909a-4e2f-8665-fb2027bb970f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:01.067995 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6d373478-909a-4e2f-8665-fb2027bb970f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:01.076519 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d373478-909a-4e2f-8665-fb2027bb970f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:01.076519 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d373478-909a-4e2f-8665-fb2027bb970f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:01.076519 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d373478-909a-4e2f-8665-fb2027bb970f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:01.076519 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d373478-909a-4e2f-8665-fb2027bb970f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:01.079223 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d373478-909a-4e2f-8665-fb2027bb970f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:01.079223 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d373478-909a-4e2f-8665-fb2027bb970f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:01.148655 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6d373478-909a-4e2f-8665-fb2027bb970f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:01.158614 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6d373478-909a-4e2f-8665-fb2027bb970f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1194 microversion: 2.1 time: 0.095680 Aug 10 17:27:01.159216 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 576/1138] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:01 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:27:02.182484 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4a4afc73-4dc4-4d54-8bc2-e9a48cbebf99 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:02.183136 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4a4afc73-4dc4-4d54-8bc2-e9a48cbebf99 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:02.190105 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a4afc73-4dc4-4d54-8bc2-e9a48cbebf99 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:02.190632 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a4afc73-4dc4-4d54-8bc2-e9a48cbebf99 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:02.191081 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a4afc73-4dc4-4d54-8bc2-e9a48cbebf99 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:02.192296 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a4afc73-4dc4-4d54-8bc2-e9a48cbebf99 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:02.193199 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a4afc73-4dc4-4d54-8bc2-e9a48cbebf99 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:02.193844 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a4afc73-4dc4-4d54-8bc2-e9a48cbebf99 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:02.335974 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4a4afc73-4dc4-4d54-8bc2-e9a48cbebf99 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:02.345859 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4a4afc73-4dc4-4d54-8bc2-e9a48cbebf99 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1270 microversion: 2.1 time: 0.168351 Aug 10 17:27:02.346385 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 563/1139] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:02 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:27:02.910327 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-c24cdfdc-0d4e-49a5-b986-d7dc290393c5 req-6168b565-6cc0-4fca-aa0b-e8309305064f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562c3b53-8ece-446c-951f-178341b686c4", "tag": "6424d455-4fc6-4adf-b5ba-d144e57ecff7"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:27:02.920566 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c24cdfdc-0d4e-49a5-b986-d7dc290393c5 req-6168b565-6cc0-4fca-aa0b-e8309305064f service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:02.921041 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c24cdfdc-0d4e-49a5-b986-d7dc290393c5 req-6168b565-6cc0-4fca-aa0b-e8309305064f service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:02.921478 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c24cdfdc-0d4e-49a5-b986-d7dc290393c5 req-6168b565-6cc0-4fca-aa0b-e8309305064f service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:02.938172 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-c24cdfdc-0d4e-49a5-b986-d7dc290393c5 req-6168b565-6cc0-4fca-aa0b-e8309305064f service nova] Creating event network-changed:6424d455-4fc6-4adf-b5ba-d144e57ecff7 for instance 562c3b53-8ece-446c-951f-178341b686c4 on hv-cinder-85272 Aug 10 17:27:02.940613 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-c24cdfdc-0d4e-49a5-b986-d7dc290393c5 req-6168b565-6cc0-4fca-aa0b-e8309305064f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034821 Aug 10 17:27:02.942511 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 577/1140] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:27:03.368297 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-17963bbf-5d8f-432a-8a4b-3e3b2844077c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:03.369018 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-17963bbf-5d8f-432a-8a4b-3e3b2844077c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:03.375785 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17963bbf-5d8f-432a-8a4b-3e3b2844077c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:03.376284 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17963bbf-5d8f-432a-8a4b-3e3b2844077c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:03.376727 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17963bbf-5d8f-432a-8a4b-3e3b2844077c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:03.377438 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17963bbf-5d8f-432a-8a4b-3e3b2844077c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:03.377898 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17963bbf-5d8f-432a-8a4b-3e3b2844077c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:03.379385 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17963bbf-5d8f-432a-8a4b-3e3b2844077c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:03.517954 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-17963bbf-5d8f-432a-8a4b-3e3b2844077c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:03.526497 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-17963bbf-5d8f-432a-8a4b-3e3b2844077c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1258 microversion: 2.1 time: 0.162079 Aug 10 17:27:03.527188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 564/1141] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:03 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:27:04.548611 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b2bddb2a-b1a5-43e8-b061-cb5d7d44495c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:04.549314 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b2bddb2a-b1a5-43e8-b061-cb5d7d44495c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:04.556776 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2bddb2a-b1a5-43e8-b061-cb5d7d44495c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:04.557328 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2bddb2a-b1a5-43e8-b061-cb5d7d44495c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:04.557770 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2bddb2a-b1a5-43e8-b061-cb5d7d44495c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:04.558509 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2bddb2a-b1a5-43e8-b061-cb5d7d44495c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:04.558991 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2bddb2a-b1a5-43e8-b061-cb5d7d44495c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:04.559398 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2bddb2a-b1a5-43e8-b061-cb5d7d44495c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:04.703933 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b2bddb2a-b1a5-43e8-b061-cb5d7d44495c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:04.712726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b2bddb2a-b1a5-43e8-b061-cb5d7d44495c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1258 microversion: 2.1 time: 0.168439 Aug 10 17:27:04.713323 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 578/1142] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:04 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:27:05.734625 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-553c2fc2-f0d1-48dc-ae5d-47b5463b1a6e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:05.735247 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-553c2fc2-f0d1-48dc-ae5d-47b5463b1a6e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:05.742132 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-553c2fc2-f0d1-48dc-ae5d-47b5463b1a6e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:05.742664 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-553c2fc2-f0d1-48dc-ae5d-47b5463b1a6e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:05.743107 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-553c2fc2-f0d1-48dc-ae5d-47b5463b1a6e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:05.743822 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-553c2fc2-f0d1-48dc-ae5d-47b5463b1a6e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:05.744283 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-553c2fc2-f0d1-48dc-ae5d-47b5463b1a6e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:05.744717 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-553c2fc2-f0d1-48dc-ae5d-47b5463b1a6e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:05.897346 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-553c2fc2-f0d1-48dc-ae5d-47b5463b1a6e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:05.905201 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-553c2fc2-f0d1-48dc-ae5d-47b5463b1a6e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1258 microversion: 2.1 time: 0.174383 Aug 10 17:27:05.905782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 565/1143] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:05 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:27:06.927621 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8d8ae90f-0f87-4726-889c-99b21aa8d7e6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:06.928226 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8d8ae90f-0f87-4726-889c-99b21aa8d7e6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:06.935183 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d8ae90f-0f87-4726-889c-99b21aa8d7e6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:06.935680 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d8ae90f-0f87-4726-889c-99b21aa8d7e6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:06.936119 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d8ae90f-0f87-4726-889c-99b21aa8d7e6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:06.936841 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d8ae90f-0f87-4726-889c-99b21aa8d7e6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:06.937300 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d8ae90f-0f87-4726-889c-99b21aa8d7e6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:06.937731 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d8ae90f-0f87-4726-889c-99b21aa8d7e6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:07.084147 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8d8ae90f-0f87-4726-889c-99b21aa8d7e6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:07.092195 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8d8ae90f-0f87-4726-889c-99b21aa8d7e6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1258 microversion: 2.1 time: 0.168774 Aug 10 17:27:07.092783 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 579/1144] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:06 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:27:08.117736 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1e3f1bcc-d0b6-4e5c-9893-f9a6774eefbc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:08.118327 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1e3f1bcc-d0b6-4e5c-9893-f9a6774eefbc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:08.124958 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e3f1bcc-d0b6-4e5c-9893-f9a6774eefbc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:08.125634 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e3f1bcc-d0b6-4e5c-9893-f9a6774eefbc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:08.125895 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e3f1bcc-d0b6-4e5c-9893-f9a6774eefbc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:08.126621 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e3f1bcc-d0b6-4e5c-9893-f9a6774eefbc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:08.127070 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e3f1bcc-d0b6-4e5c-9893-f9a6774eefbc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:08.127486 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e3f1bcc-d0b6-4e5c-9893-f9a6774eefbc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:08.261599 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1e3f1bcc-d0b6-4e5c-9893-f9a6774eefbc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:08.269826 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1e3f1bcc-d0b6-4e5c-9893-f9a6774eefbc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1258 microversion: 2.1 time: 0.155356 Aug 10 17:27:08.270214 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 566/1145] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:08 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:27:09.291281 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-10c476aa-7bad-40ef-86b2-fbaf91c43d65 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:09.291814 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-10c476aa-7bad-40ef-86b2-fbaf91c43d65 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:09.294258 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:27:09.299282 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10c476aa-7bad-40ef-86b2-fbaf91c43d65 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:09.299769 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10c476aa-7bad-40ef-86b2-fbaf91c43d65 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:09.300253 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10c476aa-7bad-40ef-86b2-fbaf91c43d65 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:09.301199 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10c476aa-7bad-40ef-86b2-fbaf91c43d65 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:09.301703 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10c476aa-7bad-40ef-86b2-fbaf91c43d65 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:09.302082 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10c476aa-7bad-40ef-86b2-fbaf91c43d65 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:09.446155 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-10c476aa-7bad-40ef-86b2-fbaf91c43d65 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:09.454420 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-10c476aa-7bad-40ef-86b2-fbaf91c43d65 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1258 microversion: 2.1 time: 0.166949 Aug 10 17:27:09.455020 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 580/1146] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:09 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:27:10.476236 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-be610431-2907-438c-98b5-532e2644f125 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:10.476838 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-be610431-2907-438c-98b5-532e2644f125 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:10.478785 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:27:10.479535 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=6 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:27:10.485475 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be610431-2907-438c-98b5-532e2644f125 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:10.488730 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be610431-2907-438c-98b5-532e2644f125 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:10.488730 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be610431-2907-438c-98b5-532e2644f125 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:10.488730 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be610431-2907-438c-98b5-532e2644f125 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:10.488730 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be610431-2907-438c-98b5-532e2644f125 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:10.489135 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be610431-2907-438c-98b5-532e2644f125 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:10.641462 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-be610431-2907-438c-98b5-532e2644f125 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:10.655503 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-be610431-2907-438c-98b5-532e2644f125 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1258 microversion: 2.1 time: 0.183406 Aug 10 17:27:10.656562 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 567/1147] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:10 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:27:11.678256 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-680f26f3-a1b5-4a10-a085-f97fd0f965a8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:11.678898 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-680f26f3-a1b5-4a10-a085-f97fd0f965a8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:11.685602 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-680f26f3-a1b5-4a10-a085-f97fd0f965a8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:11.686091 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-680f26f3-a1b5-4a10-a085-f97fd0f965a8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:11.686555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-680f26f3-a1b5-4a10-a085-f97fd0f965a8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:11.687270 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-680f26f3-a1b5-4a10-a085-f97fd0f965a8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:11.687722 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-680f26f3-a1b5-4a10-a085-f97fd0f965a8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:11.688146 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-680f26f3-a1b5-4a10-a085-f97fd0f965a8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:11.829336 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-680f26f3-a1b5-4a10-a085-f97fd0f965a8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:11.838080 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-680f26f3-a1b5-4a10-a085-f97fd0f965a8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1258 microversion: 2.1 time: 0.164222 Aug 10 17:27:11.838717 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 581/1148] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:11 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:27:12.859275 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-26bd34fb-c66d-4a41-8357-ac55433c2734 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:12.859907 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-26bd34fb-c66d-4a41-8357-ac55433c2734 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:12.866724 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26bd34fb-c66d-4a41-8357-ac55433c2734 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:12.867217 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26bd34fb-c66d-4a41-8357-ac55433c2734 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:12.867659 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26bd34fb-c66d-4a41-8357-ac55433c2734 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:12.868361 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26bd34fb-c66d-4a41-8357-ac55433c2734 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:12.868819 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26bd34fb-c66d-4a41-8357-ac55433c2734 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:12.869244 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26bd34fb-c66d-4a41-8357-ac55433c2734 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:13.013486 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-26bd34fb-c66d-4a41-8357-ac55433c2734 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:13.022629 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-26bd34fb-c66d-4a41-8357-ac55433c2734 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1258 microversion: 2.1 time: 0.167242 Aug 10 17:27:13.023204 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 568/1149] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:12 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:27:14.044138 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0ab2e2d3-5072-4a14-bc9d-b25712a17694 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:14.044803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0ab2e2d3-5072-4a14-bc9d-b25712a17694 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:14.052270 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ab2e2d3-5072-4a14-bc9d-b25712a17694 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:14.052769 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ab2e2d3-5072-4a14-bc9d-b25712a17694 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:14.053212 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ab2e2d3-5072-4a14-bc9d-b25712a17694 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:14.053943 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ab2e2d3-5072-4a14-bc9d-b25712a17694 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:14.054427 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ab2e2d3-5072-4a14-bc9d-b25712a17694 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:14.054862 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ab2e2d3-5072-4a14-bc9d-b25712a17694 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:14.208428 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-2f59d190-2f54-4059-917c-63bc35eaf0a7 req-1a098403-b916-4fc9-b4ad-84e3fd501f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562c3b53-8ece-446c-951f-178341b686c4", "name": "network-vif-plugged", "status": "completed", "tag": "6424d455-4fc6-4adf-b5ba-d144e57ecff7"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:27:14.225920 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2f59d190-2f54-4059-917c-63bc35eaf0a7 req-1a098403-b916-4fc9-b4ad-84e3fd501f6a service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:14.226997 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2f59d190-2f54-4059-917c-63bc35eaf0a7 req-1a098403-b916-4fc9-b4ad-84e3fd501f6a service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:14.227747 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2f59d190-2f54-4059-917c-63bc35eaf0a7 req-1a098403-b916-4fc9-b4ad-84e3fd501f6a service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:14.242565 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-2f59d190-2f54-4059-917c-63bc35eaf0a7 req-1a098403-b916-4fc9-b4ad-84e3fd501f6a service nova] Creating event network-vif-plugged:6424d455-4fc6-4adf-b5ba-d144e57ecff7 for instance 562c3b53-8ece-446c-951f-178341b686c4 on hv-cinder-85272 Aug 10 17:27:14.250138 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-2f59d190-2f54-4059-917c-63bc35eaf0a7 req-1a098403-b916-4fc9-b4ad-84e3fd501f6a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127916 Aug 10 17:27:14.250832 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 569/1150] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:27:14.254663 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0ab2e2d3-5072-4a14-bc9d-b25712a17694 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:14.264142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0ab2e2d3-5072-4a14-bc9d-b25712a17694 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1258 microversion: 2.1 time: 0.223421 Aug 10 17:27:14.264405 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 582/1151] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:14 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1258 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:27:15.286958 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d0a93f3f-693b-4d2f-8243-44f3f0b10296 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:15.287671 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d0a93f3f-693b-4d2f-8243-44f3f0b10296 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:15.293978 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d0a93f3f-693b-4d2f-8243-44f3f0b10296 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:15.294510 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d0a93f3f-693b-4d2f-8243-44f3f0b10296 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:15.294952 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d0a93f3f-693b-4d2f-8243-44f3f0b10296 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:15.295663 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d0a93f3f-693b-4d2f-8243-44f3f0b10296 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:15.296115 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d0a93f3f-693b-4d2f-8243-44f3f0b10296 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:15.296540 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d0a93f3f-693b-4d2f-8243-44f3f0b10296 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:15.446320 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d0a93f3f-693b-4d2f-8243-44f3f0b10296 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:15.454189 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d0a93f3f-693b-4d2f-8243-44f3f0b10296 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1258 microversion: 2.1 time: 0.172663 Aug 10 17:27:15.454802 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 570/1152] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:15 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:27:16.475879 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-45c67829-8b5b-4569-930e-3bb1fc7180d1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:16.476514 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-45c67829-8b5b-4569-930e-3bb1fc7180d1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:16.482649 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45c67829-8b5b-4569-930e-3bb1fc7180d1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:16.483141 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45c67829-8b5b-4569-930e-3bb1fc7180d1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:16.483586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45c67829-8b5b-4569-930e-3bb1fc7180d1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:16.484294 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45c67829-8b5b-4569-930e-3bb1fc7180d1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:16.484759 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45c67829-8b5b-4569-930e-3bb1fc7180d1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:16.485187 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45c67829-8b5b-4569-930e-3bb1fc7180d1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:16.633951 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-45c67829-8b5b-4569-930e-3bb1fc7180d1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:16.642269 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-45c67829-8b5b-4569-930e-3bb1fc7180d1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1441 microversion: 2.1 time: 0.170566 Aug 10 17:27:16.643258 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 583/1153] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:16 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1441 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:27:16.664843 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1518324c-5e3c-4276-9f52-24d34021cd8e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:27:16.665500 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1518324c-5e3c-4276-9f52-24d34021cd8e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:27:16.672205 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1518324c-5e3c-4276-9f52-24d34021cd8e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:16.675338 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1518324c-5e3c-4276-9f52-24d34021cd8e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:16.675338 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1518324c-5e3c-4276-9f52-24d34021cd8e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:16.675338 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1518324c-5e3c-4276-9f52-24d34021cd8e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:16.675338 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1518324c-5e3c-4276-9f52-24d34021cd8e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:16.675908 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1518324c-5e3c-4276-9f52-24d34021cd8e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:16.832859 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1518324c-5e3c-4276-9f52-24d34021cd8e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:27:16.841163 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1518324c-5e3c-4276-9f52-24d34021cd8e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1441 microversion: 2.1 time: 0.180607 Aug 10 17:27:16.841751 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 571/1154] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:27:16 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1441 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:27:19.044752 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-9e3c674c-798e-41f2-b595-d291a1f00fd1 req-acaea671-0085-475c-9a68-7b5673226f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562c3b53-8ece-446c-951f-178341b686c4", "tag": "6424d455-4fc6-4adf-b5ba-d144e57ecff7"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:27:19.055901 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-9e3c674c-798e-41f2-b595-d291a1f00fd1 req-acaea671-0085-475c-9a68-7b5673226f4c service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:27:19.056517 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-9e3c674c-798e-41f2-b595-d291a1f00fd1 req-acaea671-0085-475c-9a68-7b5673226f4c service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:27:19.056917 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-9e3c674c-798e-41f2-b595-d291a1f00fd1 req-acaea671-0085-475c-9a68-7b5673226f4c service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:27:19.069401 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-9e3c674c-798e-41f2-b595-d291a1f00fd1 req-acaea671-0085-475c-9a68-7b5673226f4c service nova] Creating event network-changed:6424d455-4fc6-4adf-b5ba-d144e57ecff7 for instance 562c3b53-8ece-446c-951f-178341b686c4 on hv-cinder-85272 Aug 10 17:27:19.075266 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-9e3c674c-798e-41f2-b595-d291a1f00fd1 req-acaea671-0085-475c-9a68-7b5673226f4c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034137 Aug 10 17:27:19.075888 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 584/1155] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:27:45.265116 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:27:45.265859 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Wed Aug 10 17:27:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:29:13.745087 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:29:13.745851 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=58 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:29:13.749879 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6c6dff63-928f-4217-8522-aa1f53538602 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:29:13.750503 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6c6dff63-928f-4217-8522-aa1f53538602 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:13.768587 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c6dff63-928f-4217-8522-aa1f53538602 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:13.768587 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c6dff63-928f-4217-8522-aa1f53538602 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:13.768587 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c6dff63-928f-4217-8522-aa1f53538602 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:13.768587 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c6dff63-928f-4217-8522-aa1f53538602 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:13.769019 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c6dff63-928f-4217-8522-aa1f53538602 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:13.769019 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c6dff63-928f-4217-8522-aa1f53538602 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:13.783065 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-6c6dff63-928f-4217-8522-aa1f53538602 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lazy-loading 'flavor' on Instance uuid 562c3b53-8ece-446c-951f-178341b686c4 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:29:14.047188 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6c6dff63-928f-4217-8522-aa1f53538602 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "POST /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4/action" status: 202 len: 0 microversion: 2.1 time: 0.303625 Aug 10 17:29:14.047799 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 572/1156] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:29:13 2022] POST /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:29:14.054860 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=22 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:29:14.055848 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=46 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:29:14.060302 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-01a949ab-4d61-49ab-af70-87dafe176e9f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:14.061025 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-01a949ab-4d61-49ab-af70-87dafe176e9f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:14.068076 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01a949ab-4d61-49ab-af70-87dafe176e9f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:14.068600 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01a949ab-4d61-49ab-af70-87dafe176e9f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:14.069130 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01a949ab-4d61-49ab-af70-87dafe176e9f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:14.069840 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01a949ab-4d61-49ab-af70-87dafe176e9f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:14.070298 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01a949ab-4d61-49ab-af70-87dafe176e9f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:14.070768 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01a949ab-4d61-49ab-af70-87dafe176e9f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:14.268514 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-01a949ab-4d61-49ab-af70-87dafe176e9f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:14.276320 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-01a949ab-4d61-49ab-af70-87dafe176e9f tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1566 microversion: 2.1 time: 0.223447 Aug 10 17:29:14.276881 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 585/1157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:14 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1566 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:15.299145 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7de9a7e4-8236-4eb7-a970-35920b95b13b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:15.299841 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7de9a7e4-8236-4eb7-a970-35920b95b13b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:15.306155 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7de9a7e4-8236-4eb7-a970-35920b95b13b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:15.306682 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7de9a7e4-8236-4eb7-a970-35920b95b13b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:15.307116 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7de9a7e4-8236-4eb7-a970-35920b95b13b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:15.307808 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7de9a7e4-8236-4eb7-a970-35920b95b13b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:15.308264 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7de9a7e4-8236-4eb7-a970-35920b95b13b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:15.308686 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7de9a7e4-8236-4eb7-a970-35920b95b13b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:15.491485 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7de9a7e4-8236-4eb7-a970-35920b95b13b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:15.499226 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7de9a7e4-8236-4eb7-a970-35920b95b13b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1566 microversion: 2.1 time: 0.204809 Aug 10 17:29:15.500627 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 573/1158] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:15 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:16.522273 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4de42d2a-848e-4858-9cbb-8527cbafbfb4 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:16.522863 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4de42d2a-848e-4858-9cbb-8527cbafbfb4 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:16.528737 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4de42d2a-848e-4858-9cbb-8527cbafbfb4 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:16.529214 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4de42d2a-848e-4858-9cbb-8527cbafbfb4 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:16.529644 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4de42d2a-848e-4858-9cbb-8527cbafbfb4 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:16.530332 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4de42d2a-848e-4858-9cbb-8527cbafbfb4 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:16.530931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4de42d2a-848e-4858-9cbb-8527cbafbfb4 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:16.531284 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4de42d2a-848e-4858-9cbb-8527cbafbfb4 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:16.666050 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4de42d2a-848e-4858-9cbb-8527cbafbfb4 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:16.674393 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4de42d2a-848e-4858-9cbb-8527cbafbfb4 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1566 microversion: 2.1 time: 0.156242 Aug 10 17:29:16.674966 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 586/1159] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:16 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:17.695818 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6bab9b63-6f60-49a8-b3f0-7755e232117b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:17.696438 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6bab9b63-6f60-49a8-b3f0-7755e232117b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:17.703038 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6bab9b63-6f60-49a8-b3f0-7755e232117b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:17.703530 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6bab9b63-6f60-49a8-b3f0-7755e232117b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:17.704525 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6bab9b63-6f60-49a8-b3f0-7755e232117b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:17.705235 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6bab9b63-6f60-49a8-b3f0-7755e232117b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:17.705691 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6bab9b63-6f60-49a8-b3f0-7755e232117b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:17.706152 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6bab9b63-6f60-49a8-b3f0-7755e232117b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:17.843486 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6bab9b63-6f60-49a8-b3f0-7755e232117b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:17.851358 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6bab9b63-6f60-49a8-b3f0-7755e232117b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1566 microversion: 2.1 time: 0.159564 Aug 10 17:29:17.851913 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 574/1160] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:17 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:18.872736 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-303bbcc2-844e-4552-936c-d065d96f451a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:18.873328 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-303bbcc2-844e-4552-936c-d065d96f451a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:18.881029 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-303bbcc2-844e-4552-936c-d065d96f451a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:18.881518 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-303bbcc2-844e-4552-936c-d065d96f451a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:18.881959 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-303bbcc2-844e-4552-936c-d065d96f451a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:18.882690 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-303bbcc2-844e-4552-936c-d065d96f451a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:18.883150 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-303bbcc2-844e-4552-936c-d065d96f451a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:18.883580 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-303bbcc2-844e-4552-936c-d065d96f451a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:19.020051 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-303bbcc2-844e-4552-936c-d065d96f451a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:19.027792 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-303bbcc2-844e-4552-936c-d065d96f451a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1566 microversion: 2.1 time: 0.158990 Aug 10 17:29:19.028361 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 587/1161] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:18 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:20.049266 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-172d4c9f-8fb8-4dd8-b6b6-077d2c2e0cfc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:20.049800 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-172d4c9f-8fb8-4dd8-b6b6-077d2c2e0cfc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:20.056403 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-172d4c9f-8fb8-4dd8-b6b6-077d2c2e0cfc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:20.056888 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-172d4c9f-8fb8-4dd8-b6b6-077d2c2e0cfc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:20.057327 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-172d4c9f-8fb8-4dd8-b6b6-077d2c2e0cfc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:20.058027 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-172d4c9f-8fb8-4dd8-b6b6-077d2c2e0cfc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:20.058514 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-172d4c9f-8fb8-4dd8-b6b6-077d2c2e0cfc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:20.058944 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-172d4c9f-8fb8-4dd8-b6b6-077d2c2e0cfc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:20.205526 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-172d4c9f-8fb8-4dd8-b6b6-077d2c2e0cfc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:20.213158 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-172d4c9f-8fb8-4dd8-b6b6-077d2c2e0cfc tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1566 microversion: 2.1 time: 0.167870 Aug 10 17:29:20.213734 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 575/1162] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:20 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:21.234250 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0450bb68-df03-4146-9e22-f5b93ef7074e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:21.234919 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0450bb68-df03-4146-9e22-f5b93ef7074e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:21.241583 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0450bb68-df03-4146-9e22-f5b93ef7074e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:21.242094 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0450bb68-df03-4146-9e22-f5b93ef7074e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:21.242561 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0450bb68-df03-4146-9e22-f5b93ef7074e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:21.243277 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0450bb68-df03-4146-9e22-f5b93ef7074e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:21.243735 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0450bb68-df03-4146-9e22-f5b93ef7074e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:21.245658 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0450bb68-df03-4146-9e22-f5b93ef7074e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:21.379552 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0450bb68-df03-4146-9e22-f5b93ef7074e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:21.387142 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0450bb68-df03-4146-9e22-f5b93ef7074e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1566 microversion: 2.1 time: 0.156762 Aug 10 17:29:21.387703 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 588/1163] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:21 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:22.409281 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0f05d6c2-2bc8-4016-804e-769e936e9f5a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:22.409905 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0f05d6c2-2bc8-4016-804e-769e936e9f5a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:22.415973 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f05d6c2-2bc8-4016-804e-769e936e9f5a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:22.416462 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f05d6c2-2bc8-4016-804e-769e936e9f5a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:22.416904 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f05d6c2-2bc8-4016-804e-769e936e9f5a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:22.417609 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f05d6c2-2bc8-4016-804e-769e936e9f5a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:22.418070 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f05d6c2-2bc8-4016-804e-769e936e9f5a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:22.418609 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f05d6c2-2bc8-4016-804e-769e936e9f5a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:22.554565 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0f05d6c2-2bc8-4016-804e-769e936e9f5a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:22.562309 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0f05d6c2-2bc8-4016-804e-769e936e9f5a tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1566 microversion: 2.1 time: 0.157038 Aug 10 17:29:22.562898 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 576/1164] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:22 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:23.586194 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-00b9114c-3645-4818-a166-65b9a7428404 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:23.587312 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-00b9114c-3645-4818-a166-65b9a7428404 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:23.594319 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00b9114c-3645-4818-a166-65b9a7428404 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:23.595609 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00b9114c-3645-4818-a166-65b9a7428404 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:23.595993 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00b9114c-3645-4818-a166-65b9a7428404 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:23.596802 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00b9114c-3645-4818-a166-65b9a7428404 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:23.597159 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00b9114c-3645-4818-a166-65b9a7428404 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:23.597586 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00b9114c-3645-4818-a166-65b9a7428404 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:23.748576 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-00b9114c-3645-4818-a166-65b9a7428404 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:23.758091 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-00b9114c-3645-4818-a166-65b9a7428404 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1566 microversion: 2.1 time: 0.175738 Aug 10 17:29:23.758979 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 589/1165] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:23 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:29:24.784089 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ce0bc2b6-3d9a-4847-baa9-27bdefc2e890 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:24.784738 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ce0bc2b6-3d9a-4847-baa9-27bdefc2e890 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:24.791352 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ce0bc2b6-3d9a-4847-baa9-27bdefc2e890 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:24.791840 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ce0bc2b6-3d9a-4847-baa9-27bdefc2e890 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:24.792272 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ce0bc2b6-3d9a-4847-baa9-27bdefc2e890 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:24.793091 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ce0bc2b6-3d9a-4847-baa9-27bdefc2e890 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:24.793417 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ce0bc2b6-3d9a-4847-baa9-27bdefc2e890 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:24.793832 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ce0bc2b6-3d9a-4847-baa9-27bdefc2e890 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:24.936431 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ce0bc2b6-3d9a-4847-baa9-27bdefc2e890 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:24.944725 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ce0bc2b6-3d9a-4847-baa9-27bdefc2e890 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1566 microversion: 2.1 time: 0.165225 Aug 10 17:29:24.945301 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 577/1166] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:24 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:25.966290 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2a0fce38-d0d6-4691-a271-c0189c9278e1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:25.966894 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2a0fce38-d0d6-4691-a271-c0189c9278e1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:25.974058 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a0fce38-d0d6-4691-a271-c0189c9278e1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:25.974595 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a0fce38-d0d6-4691-a271-c0189c9278e1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:25.975037 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a0fce38-d0d6-4691-a271-c0189c9278e1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:25.975734 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a0fce38-d0d6-4691-a271-c0189c9278e1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:25.976188 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a0fce38-d0d6-4691-a271-c0189c9278e1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:25.976613 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a0fce38-d0d6-4691-a271-c0189c9278e1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:26.366496 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2a0fce38-d0d6-4691-a271-c0189c9278e1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:26.374275 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2a0fce38-d0d6-4691-a271-c0189c9278e1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1566 microversion: 2.1 time: 0.411934 Aug 10 17:29:26.374893 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 590/1167] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:25 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1566 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:27.396642 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6fe74d81-e1a0-4577-8fa2-d79e49cdcb94 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:27.397261 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6fe74d81-e1a0-4577-8fa2-d79e49cdcb94 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:27.403739 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6fe74d81-e1a0-4577-8fa2-d79e49cdcb94 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:27.406671 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6fe74d81-e1a0-4577-8fa2-d79e49cdcb94 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:27.406671 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6fe74d81-e1a0-4577-8fa2-d79e49cdcb94 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:27.406671 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6fe74d81-e1a0-4577-8fa2-d79e49cdcb94 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:27.406671 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6fe74d81-e1a0-4577-8fa2-d79e49cdcb94 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:27.407653 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6fe74d81-e1a0-4577-8fa2-d79e49cdcb94 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:27.551876 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6fe74d81-e1a0-4577-8fa2-d79e49cdcb94 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:27.559604 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6fe74d81-e1a0-4577-8fa2-d79e49cdcb94 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1567 microversion: 2.1 time: 0.167171 Aug 10 17:29:27.560176 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 578/1168] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:27 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:27.581559 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-df3f09a5-527d-406c-841b-c1280d4fe4b8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:29:27.582149 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-df3f09a5-527d-406c-841b-c1280d4fe4b8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:27.588892 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df3f09a5-527d-406c-841b-c1280d4fe4b8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:27.589385 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df3f09a5-527d-406c-841b-c1280d4fe4b8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:27.589825 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df3f09a5-527d-406c-841b-c1280d4fe4b8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:27.590588 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df3f09a5-527d-406c-841b-c1280d4fe4b8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:27.591047 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df3f09a5-527d-406c-841b-c1280d4fe4b8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:27.591478 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df3f09a5-527d-406c-841b-c1280d4fe4b8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:27.680821 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-df3f09a5-527d-406c-841b-c1280d4fe4b8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121232) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 17:29:27.994407 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-df3f09a5-527d-406c-841b-c1280d4fe4b8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "POST /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4/action" status: 202 len: 0 microversion: 2.1 time: 0.417586 Aug 10 17:29:27.994964 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 591/1169] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 17:29:27 2022] POST /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:29:28.004549 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-baa53e63-3309-421e-b9ae-c53612002148 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:28.008930 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-baa53e63-3309-421e-b9ae-c53612002148 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:28.011598 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-baa53e63-3309-421e-b9ae-c53612002148 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:28.012063 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-baa53e63-3309-421e-b9ae-c53612002148 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:28.012505 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-baa53e63-3309-421e-b9ae-c53612002148 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:28.013222 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-baa53e63-3309-421e-b9ae-c53612002148 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:28.013681 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-baa53e63-3309-421e-b9ae-c53612002148 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:28.014108 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-baa53e63-3309-421e-b9ae-c53612002148 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:28.161198 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-baa53e63-3309-421e-b9ae-c53612002148 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:28.169283 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-baa53e63-3309-421e-b9ae-c53612002148 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1515 microversion: 2.1 time: 0.169799 Aug 10 17:29:28.170044 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 579/1170] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:27 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:29.191693 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-14d411fc-aa49-418e-a798-3d3186c454cd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:29.192335 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-14d411fc-aa49-418e-a798-3d3186c454cd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:29.198824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14d411fc-aa49-418e-a798-3d3186c454cd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:29.201305 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14d411fc-aa49-418e-a798-3d3186c454cd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:29.201305 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14d411fc-aa49-418e-a798-3d3186c454cd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:29.201305 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14d411fc-aa49-418e-a798-3d3186c454cd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:29.201305 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14d411fc-aa49-418e-a798-3d3186c454cd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:29.202152 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14d411fc-aa49-418e-a798-3d3186c454cd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:29.343440 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-14d411fc-aa49-418e-a798-3d3186c454cd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:29.353330 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-14d411fc-aa49-418e-a798-3d3186c454cd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1517 microversion: 2.1 time: 0.165957 Aug 10 17:29:29.353922 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 592/1171] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:29 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:30.376767 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d764c577-93ea-44fb-93f3-5de4fa4a1de5 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:30.377706 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d764c577-93ea-44fb-93f3-5de4fa4a1de5 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:30.384363 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d764c577-93ea-44fb-93f3-5de4fa4a1de5 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:30.384852 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d764c577-93ea-44fb-93f3-5de4fa4a1de5 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:30.385285 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d764c577-93ea-44fb-93f3-5de4fa4a1de5 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:30.385989 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d764c577-93ea-44fb-93f3-5de4fa4a1de5 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:30.386558 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d764c577-93ea-44fb-93f3-5de4fa4a1de5 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:30.386986 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d764c577-93ea-44fb-93f3-5de4fa4a1de5 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:30.529185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d764c577-93ea-44fb-93f3-5de4fa4a1de5 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:30.538387 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d764c577-93ea-44fb-93f3-5de4fa4a1de5 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1517 microversion: 2.1 time: 0.166851 Aug 10 17:29:30.543067 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 580/1172] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:30 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:30.563106 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-9fbf342e-488b-4ef8-8e3e-7baefb988525 req-94682f27-c16d-408c-bab7-3b349d6f8bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562c3b53-8ece-446c-951f-178341b686c4", "name": "network-vif-unplugged", "status": "completed", "tag": "6424d455-4fc6-4adf-b5ba-d144e57ecff7"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:29:30.575493 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-9fbf342e-488b-4ef8-8e3e-7baefb988525 req-94682f27-c16d-408c-bab7-3b349d6f8bfe service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:30.575996 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-9fbf342e-488b-4ef8-8e3e-7baefb988525 req-94682f27-c16d-408c-bab7-3b349d6f8bfe service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:30.576635 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-9fbf342e-488b-4ef8-8e3e-7baefb988525 req-94682f27-c16d-408c-bab7-3b349d6f8bfe service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:30.590506 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-9fbf342e-488b-4ef8-8e3e-7baefb988525 req-94682f27-c16d-408c-bab7-3b349d6f8bfe service nova] Creating event network-vif-unplugged:6424d455-4fc6-4adf-b5ba-d144e57ecff7 for instance 562c3b53-8ece-446c-951f-178341b686c4 on hv-cinder-85272 Aug 10 17:29:30.596809 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-9fbf342e-488b-4ef8-8e3e-7baefb988525 req-94682f27-c16d-408c-bab7-3b349d6f8bfe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038366 Aug 10 17:29:30.597612 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 593/1173] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 17:29:30.998285 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:29:30.998560 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Wed Aug 10 17:29:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:29:31.561185 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-74eb0113-a6bc-4300-bfef-def3859edd0e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:31.561885 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-74eb0113-a6bc-4300-bfef-def3859edd0e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:31.569344 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74eb0113-a6bc-4300-bfef-def3859edd0e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:31.569847 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74eb0113-a6bc-4300-bfef-def3859edd0e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:31.570286 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74eb0113-a6bc-4300-bfef-def3859edd0e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:31.571018 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74eb0113-a6bc-4300-bfef-def3859edd0e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:31.571478 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74eb0113-a6bc-4300-bfef-def3859edd0e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:31.571904 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74eb0113-a6bc-4300-bfef-def3859edd0e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:31.713544 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-74eb0113-a6bc-4300-bfef-def3859edd0e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:31.722933 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-74eb0113-a6bc-4300-bfef-def3859edd0e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1573 microversion: 2.1 time: 0.165528 Aug 10 17:29:31.723526 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 581/1174] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:31 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:31.916230 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:29:31.916824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Wed Aug 10 17:29:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:29:32.745622 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a6dabc24-e7e2-4533-adbf-90fe2207b71e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:32.746242 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a6dabc24-e7e2-4533-adbf-90fe2207b71e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:32.753554 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6dabc24-e7e2-4533-adbf-90fe2207b71e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:32.754045 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6dabc24-e7e2-4533-adbf-90fe2207b71e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:32.754516 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6dabc24-e7e2-4533-adbf-90fe2207b71e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:32.755226 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6dabc24-e7e2-4533-adbf-90fe2207b71e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:32.755681 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6dabc24-e7e2-4533-adbf-90fe2207b71e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:32.756106 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6dabc24-e7e2-4533-adbf-90fe2207b71e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:32.895989 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a6dabc24-e7e2-4533-adbf-90fe2207b71e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:32.903769 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a6dabc24-e7e2-4533-adbf-90fe2207b71e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1573 microversion: 2.1 time: 0.163107 Aug 10 17:29:32.904348 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 594/1175] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:32 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:33.926389 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3317f375-7c25-41ff-933f-e14310610b30 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:33.927619 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3317f375-7c25-41ff-933f-e14310610b30 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:33.934107 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3317f375-7c25-41ff-933f-e14310610b30 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:33.934630 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3317f375-7c25-41ff-933f-e14310610b30 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:33.935082 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3317f375-7c25-41ff-933f-e14310610b30 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:33.935782 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3317f375-7c25-41ff-933f-e14310610b30 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:33.936237 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3317f375-7c25-41ff-933f-e14310610b30 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:33.936662 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3317f375-7c25-41ff-933f-e14310610b30 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:34.073386 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3317f375-7c25-41ff-933f-e14310610b30 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:34.081454 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3317f375-7c25-41ff-933f-e14310610b30 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1573 microversion: 2.1 time: 0.159673 Aug 10 17:29:34.082024 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 582/1176] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:33 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:35.103135 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a05cd16c-bc05-461c-b014-12b8a6465609 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:35.103760 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a05cd16c-bc05-461c-b014-12b8a6465609 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:35.110762 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a05cd16c-bc05-461c-b014-12b8a6465609 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:35.111166 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a05cd16c-bc05-461c-b014-12b8a6465609 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:35.111603 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a05cd16c-bc05-461c-b014-12b8a6465609 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:35.112310 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a05cd16c-bc05-461c-b014-12b8a6465609 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:35.112773 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a05cd16c-bc05-461c-b014-12b8a6465609 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:35.113197 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a05cd16c-bc05-461c-b014-12b8a6465609 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:35.248388 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a05cd16c-bc05-461c-b014-12b8a6465609 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:35.256810 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a05cd16c-bc05-461c-b014-12b8a6465609 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1573 microversion: 2.1 time: 0.157516 Aug 10 17:29:35.257381 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 595/1177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:35 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:36.278961 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-59453967-097c-4fe0-bc6f-3a98e12797df tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:36.279577 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-59453967-097c-4fe0-bc6f-3a98e12797df tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:36.287127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-59453967-097c-4fe0-bc6f-3a98e12797df tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:36.287618 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-59453967-097c-4fe0-bc6f-3a98e12797df tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:36.288055 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-59453967-097c-4fe0-bc6f-3a98e12797df tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:36.288753 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-59453967-097c-4fe0-bc6f-3a98e12797df tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:36.289208 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-59453967-097c-4fe0-bc6f-3a98e12797df tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:36.289631 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-59453967-097c-4fe0-bc6f-3a98e12797df tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:36.428995 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-59453967-097c-4fe0-bc6f-3a98e12797df tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:36.436575 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-59453967-097c-4fe0-bc6f-3a98e12797df tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1573 microversion: 2.1 time: 0.161497 Aug 10 17:29:36.437135 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 583/1178] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:36 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:29:37.457115 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-55c2c758-6d8a-4d85-998d-56d329c2b0d6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:37.458112 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-55c2c758-6d8a-4d85-998d-56d329c2b0d6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:37.464763 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55c2c758-6d8a-4d85-998d-56d329c2b0d6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:37.465249 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55c2c758-6d8a-4d85-998d-56d329c2b0d6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:37.465690 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55c2c758-6d8a-4d85-998d-56d329c2b0d6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:37.466416 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55c2c758-6d8a-4d85-998d-56d329c2b0d6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:37.466873 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55c2c758-6d8a-4d85-998d-56d329c2b0d6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:37.467300 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55c2c758-6d8a-4d85-998d-56d329c2b0d6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:37.601261 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-55c2c758-6d8a-4d85-998d-56d329c2b0d6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:37.609110 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-55c2c758-6d8a-4d85-998d-56d329c2b0d6 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1573 microversion: 2.1 time: 0.156042 Aug 10 17:29:37.610454 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 596/1179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:37 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:38.631736 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ad476da1-d821-4065-81c0-efc2028a6e2e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:38.632353 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ad476da1-d821-4065-81c0-efc2028a6e2e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:38.639194 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad476da1-d821-4065-81c0-efc2028a6e2e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:38.639748 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad476da1-d821-4065-81c0-efc2028a6e2e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:38.640135 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad476da1-d821-4065-81c0-efc2028a6e2e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:38.641407 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad476da1-d821-4065-81c0-efc2028a6e2e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:38.641966 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad476da1-d821-4065-81c0-efc2028a6e2e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:38.642429 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad476da1-d821-4065-81c0-efc2028a6e2e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:38.781254 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ad476da1-d821-4065-81c0-efc2028a6e2e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:38.788900 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ad476da1-d821-4065-81c0-efc2028a6e2e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1573 microversion: 2.1 time: 0.161368 Aug 10 17:29:38.789470 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 584/1180] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:38 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:39.809272 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7ec8a15d-9b53-4922-8498-c906a2a2a8fa tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:39.809824 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7ec8a15d-9b53-4922-8498-c906a2a2a8fa tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:39.816922 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ec8a15d-9b53-4922-8498-c906a2a2a8fa tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:39.817397 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ec8a15d-9b53-4922-8498-c906a2a2a8fa tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:39.817825 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ec8a15d-9b53-4922-8498-c906a2a2a8fa tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:39.818550 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ec8a15d-9b53-4922-8498-c906a2a2a8fa tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:39.818992 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ec8a15d-9b53-4922-8498-c906a2a2a8fa tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:39.819412 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ec8a15d-9b53-4922-8498-c906a2a2a8fa tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:39.958027 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7ec8a15d-9b53-4922-8498-c906a2a2a8fa tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:39.965966 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7ec8a15d-9b53-4922-8498-c906a2a2a8fa tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1573 microversion: 2.1 time: 0.160533 Aug 10 17:29:39.966914 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 597/1181] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:39 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:40.992009 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7977a11e-c2fa-4ddb-a273-f6ab0e3a69dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:40.992581 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7977a11e-c2fa-4ddb-a273-f6ab0e3a69dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:40.999101 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7977a11e-c2fa-4ddb-a273-f6ab0e3a69dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:40.999589 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7977a11e-c2fa-4ddb-a273-f6ab0e3a69dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:41.000022 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7977a11e-c2fa-4ddb-a273-f6ab0e3a69dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:41.001680 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7977a11e-c2fa-4ddb-a273-f6ab0e3a69dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:41.002467 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7977a11e-c2fa-4ddb-a273-f6ab0e3a69dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:41.002912 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7977a11e-c2fa-4ddb-a273-f6ab0e3a69dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:41.142825 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7977a11e-c2fa-4ddb-a273-f6ab0e3a69dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:41.150447 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7977a11e-c2fa-4ddb-a273-f6ab0e3a69dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1573 microversion: 2.1 time: 0.162378 Aug 10 17:29:41.151021 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 585/1182] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:40 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:42.172374 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-78e777a4-d257-4d76-a02c-bf4076773c9b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:42.172986 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-78e777a4-d257-4d76-a02c-bf4076773c9b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:42.179486 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78e777a4-d257-4d76-a02c-bf4076773c9b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:42.179970 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78e777a4-d257-4d76-a02c-bf4076773c9b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:42.180408 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78e777a4-d257-4d76-a02c-bf4076773c9b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:42.181112 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78e777a4-d257-4d76-a02c-bf4076773c9b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:42.181562 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78e777a4-d257-4d76-a02c-bf4076773c9b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:42.181980 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78e777a4-d257-4d76-a02c-bf4076773c9b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:42.322437 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-78e777a4-d257-4d76-a02c-bf4076773c9b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:42.330624 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-78e777a4-d257-4d76-a02c-bf4076773c9b tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1573 microversion: 2.1 time: 0.162086 Aug 10 17:29:42.331225 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 598/1183] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:42 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:42.660599 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-51effeb4-9698-45dc-af09-7022f8654196 req-70d660c8-9862-4d9a-8c2b-d6e0058f88f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562c3b53-8ece-446c-951f-178341b686c4", "name": "network-vif-plugged", "status": "completed", "tag": "6424d455-4fc6-4adf-b5ba-d144e57ecff7"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:29:42.671144 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-51effeb4-9698-45dc-af09-7022f8654196 req-70d660c8-9862-4d9a-8c2b-d6e0058f88f8 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:42.671645 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-51effeb4-9698-45dc-af09-7022f8654196 req-70d660c8-9862-4d9a-8c2b-d6e0058f88f8 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:42.672111 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-51effeb4-9698-45dc-af09-7022f8654196 req-70d660c8-9862-4d9a-8c2b-d6e0058f88f8 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:42.684248 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-51effeb4-9698-45dc-af09-7022f8654196 req-70d660c8-9862-4d9a-8c2b-d6e0058f88f8 service nova] Creating event network-vif-plugged:6424d455-4fc6-4adf-b5ba-d144e57ecff7 for instance 562c3b53-8ece-446c-951f-178341b686c4 on hv-cinder-85272 Aug 10 17:29:42.691540 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-51effeb4-9698-45dc-af09-7022f8654196 req-70d660c8-9862-4d9a-8c2b-d6e0058f88f8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034143 Aug 10 17:29:42.693955 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 586/1184] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:29:43.352856 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cc1138fa-6d86-490f-8514-ab2f361282dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:43.353578 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cc1138fa-6d86-490f-8514-ab2f361282dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:43.361207 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc1138fa-6d86-490f-8514-ab2f361282dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:43.361701 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc1138fa-6d86-490f-8514-ab2f361282dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:43.362147 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc1138fa-6d86-490f-8514-ab2f361282dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:43.362908 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc1138fa-6d86-490f-8514-ab2f361282dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:43.363365 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc1138fa-6d86-490f-8514-ab2f361282dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:43.363797 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc1138fa-6d86-490f-8514-ab2f361282dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:43.507351 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cc1138fa-6d86-490f-8514-ab2f361282dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:43.515228 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cc1138fa-6d86-490f-8514-ab2f361282dd tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1573 microversion: 2.1 time: 0.166383 Aug 10 17:29:43.515885 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 599/1185] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:43 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:29:44.539064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bd3113e5-f9b3-4f60-8f73-2b9d0c971549 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:29:44.539864 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-bd3113e5-f9b3-4f60-8f73-2b9d0c971549 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:29:44.542330 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=31 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:29:44.547565 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd3113e5-f9b3-4f60-8f73-2b9d0c971549 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:44.548119 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd3113e5-f9b3-4f60-8f73-2b9d0c971549 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:44.548556 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd3113e5-f9b3-4f60-8f73-2b9d0c971549 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:44.549268 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd3113e5-f9b3-4f60-8f73-2b9d0c971549 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:29:44.549720 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd3113e5-f9b3-4f60-8f73-2b9d0c971549 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:29:44.550146 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd3113e5-f9b3-4f60-8f73-2b9d0c971549 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:29:44.553021 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:29:44.710773 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bd3113e5-f9b3-4f60-8f73-2b9d0c971549 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:29:44.718363 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bd3113e5-f9b3-4f60-8f73-2b9d0c971549 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1560 microversion: 2.1 time: 0.183633 Aug 10 17:29:44.724754 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 587/1186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:29:44 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:31:01.362524 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:31:01.363916 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:31:01.368080 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2c50b59f-3c11-4542-a123-1de779c2b74e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:31:01.368931 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2c50b59f-3c11-4542-a123-1de779c2b74e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:31:01.369064 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:31:01.377695 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c50b59f-3c11-4542-a123-1de779c2b74e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:01.378481 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c50b59f-3c11-4542-a123-1de779c2b74e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:01.379144 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c50b59f-3c11-4542-a123-1de779c2b74e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:01.380067 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c50b59f-3c11-4542-a123-1de779c2b74e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:01.380783 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c50b59f-3c11-4542-a123-1de779c2b74e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:01.381406 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c50b59f-3c11-4542-a123-1de779c2b74e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:01.411735 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2c50b59f-3c11-4542-a123-1de779c2b74e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 17:31:01.433974 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-5352612f-f721-4ffb-bb0f-6cc37374bf5d req-af2ec332-034a-448e-b7e8-0a8c4cd2facf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562c3b53-8ece-446c-951f-178341b686c4", "tag": "6424d455-4fc6-4adf-b5ba-d144e57ecff7"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:31:01.446214 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-5352612f-f721-4ffb-bb0f-6cc37374bf5d req-af2ec332-034a-448e-b7e8-0a8c4cd2facf service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:01.447323 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-5352612f-f721-4ffb-bb0f-6cc37374bf5d req-af2ec332-034a-448e-b7e8-0a8c4cd2facf service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:01.447323 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-5352612f-f721-4ffb-bb0f-6cc37374bf5d req-af2ec332-034a-448e-b7e8-0a8c4cd2facf service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:01.462160 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-5352612f-f721-4ffb-bb0f-6cc37374bf5d req-af2ec332-034a-448e-b7e8-0a8c4cd2facf service nova] Creating event network-changed:6424d455-4fc6-4adf-b5ba-d144e57ecff7 for instance 562c3b53-8ece-446c-951f-178341b686c4 on hv-cinder-85272 Aug 10 17:31:01.469220 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-5352612f-f721-4ffb-bb0f-6cc37374bf5d req-af2ec332-034a-448e-b7e8-0a8c4cd2facf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106632 Aug 10 17:31:01.470395 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 588/1187] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:31:01.709983 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2c50b59f-3c11-4542-a123-1de779c2b74e tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "DELETE /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 204 len: 0 microversion: 2.1 time: 0.349135 Aug 10 17:31:01.710776 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 600/1188] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 17:31:01 2022] DELETE /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 17:31:01.720617 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-31fcf485-d231-407e-9e01-0aa76d968312 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:31:01.721305 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-31fcf485-d231-407e-9e01-0aa76d968312 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:31:01.728367 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-31fcf485-d231-407e-9e01-0aa76d968312 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:01.728863 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-31fcf485-d231-407e-9e01-0aa76d968312 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:01.729300 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-31fcf485-d231-407e-9e01-0aa76d968312 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:01.730057 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-31fcf485-d231-407e-9e01-0aa76d968312 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:01.730567 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-31fcf485-d231-407e-9e01-0aa76d968312 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:01.730997 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-31fcf485-d231-407e-9e01-0aa76d968312 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:01.886795 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-31fcf485-d231-407e-9e01-0aa76d968312 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:31:01.895360 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-31fcf485-d231-407e-9e01-0aa76d968312 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1566 microversion: 2.1 time: 0.179653 Aug 10 17:31:01.895944 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 589/1189] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:31:01 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:31:02.918726 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5292ef98-eafd-4852-9564-32bbf05ce6cb tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:31:02.919433 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5292ef98-eafd-4852-9564-32bbf05ce6cb tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:31:02.927753 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5292ef98-eafd-4852-9564-32bbf05ce6cb tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:02.928243 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5292ef98-eafd-4852-9564-32bbf05ce6cb tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:02.928682 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5292ef98-eafd-4852-9564-32bbf05ce6cb tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:02.929432 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5292ef98-eafd-4852-9564-32bbf05ce6cb tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:02.929888 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5292ef98-eafd-4852-9564-32bbf05ce6cb tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:02.930313 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5292ef98-eafd-4852-9564-32bbf05ce6cb tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:03.072407 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5292ef98-eafd-4852-9564-32bbf05ce6cb tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:31:03.080050 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5292ef98-eafd-4852-9564-32bbf05ce6cb tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1566 microversion: 2.1 time: 0.166028 Aug 10 17:31:03.080623 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 601/1190] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:31:02 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:31:04.078233 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-69b38b34-a601-4c09-94eb-fc8e431e1943 req-70968a0c-5614-4547-bbbe-9577bfaceb34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562c3b53-8ece-446c-951f-178341b686c4", "name": "network-vif-deleted", "tag": "6424d455-4fc6-4adf-b5ba-d144e57ecff7"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 17:31:04.088340 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-69b38b34-a601-4c09-94eb-fc8e431e1943 req-70968a0c-5614-4547-bbbe-9577bfaceb34 service nova] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:04.088832 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-69b38b34-a601-4c09-94eb-fc8e431e1943 req-70968a0c-5614-4547-bbbe-9577bfaceb34 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:04.089318 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-69b38b34-a601-4c09-94eb-fc8e431e1943 req-70968a0c-5614-4547-bbbe-9577bfaceb34 service nova] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:04.101131 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0ddf130d-674e-405d-be0d-3cab28cb94a1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:31:04.101682 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-69b38b34-a601-4c09-94eb-fc8e431e1943 req-70968a0c-5614-4547-bbbe-9577bfaceb34 service nova] Creating event network-vif-deleted:6424d455-4fc6-4adf-b5ba-d144e57ecff7 for instance 562c3b53-8ece-446c-951f-178341b686c4 on hv-cinder-85272 Aug 10 17:31:04.101869 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0ddf130d-674e-405d-be0d-3cab28cb94a1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:31:04.106760 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-69b38b34-a601-4c09-94eb-fc8e431e1943 req-70968a0c-5614-4547-bbbe-9577bfaceb34 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032619 Aug 10 17:31:04.107360 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 590/1191] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 17:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 17:31:04.109640 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ddf130d-674e-405d-be0d-3cab28cb94a1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:04.110198 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ddf130d-674e-405d-be0d-3cab28cb94a1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:04.112584 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ddf130d-674e-405d-be0d-3cab28cb94a1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:04.112584 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ddf130d-674e-405d-be0d-3cab28cb94a1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:04.112584 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ddf130d-674e-405d-be0d-3cab28cb94a1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:04.112584 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ddf130d-674e-405d-be0d-3cab28cb94a1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:04.181603 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0ddf130d-674e-405d-be0d-3cab28cb94a1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:31:04.189884 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0ddf130d-674e-405d-be0d-3cab28cb94a1 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1381 microversion: 2.1 time: 0.092616 Aug 10 17:31:04.192764 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 602/1192] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:31:04 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1381 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 17:31:05.212219 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-664f9110-d972-44c5-99df-3be3da038e5c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:31:05.212957 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-664f9110-d972-44c5-99df-3be3da038e5c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:31:05.219637 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664f9110-d972-44c5-99df-3be3da038e5c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:05.220126 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664f9110-d972-44c5-99df-3be3da038e5c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:05.220562 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664f9110-d972-44c5-99df-3be3da038e5c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:05.221260 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664f9110-d972-44c5-99df-3be3da038e5c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:05.221718 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664f9110-d972-44c5-99df-3be3da038e5c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:05.222143 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664f9110-d972-44c5-99df-3be3da038e5c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:05.253332 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664f9110-d972-44c5-99df-3be3da038e5c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:05.253816 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664f9110-d972-44c5-99df-3be3da038e5c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:05.254257 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664f9110-d972-44c5-99df-3be3da038e5c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:05.254758 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-664f9110-d972-44c5-99df-3be3da038e5c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lazy-loading 'fault' on Instance uuid 562c3b53-8ece-446c-951f-178341b686c4 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 17:31:05.301844 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-664f9110-d972-44c5-99df-3be3da038e5c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9736ec2b6c54177971db7277ca04c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f04e9a75b44271a9a2aa3834c5c9d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 17:31:05.309651 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-664f9110-d972-44c5-99df-3be3da038e5c tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 200 len: 1224 microversion: 2.1 time: 0.102128 Aug 10 17:31:05.310449 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 591/1193] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:31:05 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 17:31:06.331653 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-49e879bd-f2a9-4a34-bd17-92c0e9caedb8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:31:06.332351 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-49e879bd-f2a9-4a34-bd17-92c0e9caedb8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [instance: 562c3b53-8ece-446c-951f-178341b686c4] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 17:31:06.338656 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49e879bd-f2a9-4a34-bd17-92c0e9caedb8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:06.339139 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49e879bd-f2a9-4a34-bd17-92c0e9caedb8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:06.339577 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49e879bd-f2a9-4a34-bd17-92c0e9caedb8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:06.340295 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49e879bd-f2a9-4a34-bd17-92c0e9caedb8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Acquiring lock "180adeb5-bada-47d6-898d-063cb32f2e64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 17:31:06.340754 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49e879bd-f2a9-4a34-bd17-92c0e9caedb8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 17:31:06.341206 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49e879bd-f2a9-4a34-bd17-92c0e9caedb8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Lock "180adeb5-bada-47d6-898d-063cb32f2e64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 17:31:06.354340 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-49e879bd-f2a9-4a34-bd17-92c0e9caedb8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] HTTP exception thrown: Instance 562c3b53-8ece-446c-951f-178341b686c4 could not be found. Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-49e879bd-f2a9-4a34-bd17-92c0e9caedb8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Request method failure captured: Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 HTTP/1.1 Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Connection: close Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Host: 10.222.0.45 Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi8-pHmJq0hgPkUbzM-SgUbcAljXgdkwWH2UhaSLb1kIzTwguL4wbfZxYFuTRRbnOw2qXa_rS3nHShwes1lq2HHFIhVXal_Ce4JV1GUWHFJlTu1ogsFJ2PPaqGB-De_8-6lbbG-i20yED3yBKTaA75FokxI-HGhmRrZEXsu_vqKZXVVf4 Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Id: c1f04e9a75b44271a9a2aa3834c5c9d4 Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-TestShelveInstance-1670722098 Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 10 17:31:06.356101 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 10 17:31:06.358501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c1f04e9a75b44271a9a2aa3834c5c9d4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1f04e9a75b44271a9a2aa3834c5c9d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c1f04e9a75b44271a9a2aa3834c5c9d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1f04e9a75b44271a9a2aa3834c5c9d4"}]}] Aug 10 17:31:06.358501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-TestShelveInstance-1670722098 Aug 10 17:31:06.358501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Id: c1f04e9a75b44271a9a2aa3834c5c9d4 Aug 10 17:31:06.358501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-TestShelveInstance-1670722098 Aug 10 17:31:06.358501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User: tempest-TestShelveInstance-1670722098-project Aug 10 17:31:06.358501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 10 17:31:06.358501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 10 17:31:06.358501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Id: a9736ec2b6c54177971db7277ca04c1d Aug 10 17:31:06.358501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-TestShelveInstance-1670722098-project Aug 10 17:31:06.358501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: method: > Aug 10 17:31:06.358501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: exception: Instance 562c3b53-8ece-446c-951f-178341b686c4 could not be found. Aug 10 17:31:06.358501 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: action_args: {'id': '562c3b53-8ece-446c-951f-178341b686c4'} Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562c3b53-8ece-446c-951f-178341b686c4 could not be found. Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 17:31:06.359976 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562c3b53-8ece-446c-951f-178341b686c4 could not be found. Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562c3b53-8ece-446c-951f-178341b686c4 could not be found. Aug 10 17:31:06.361803 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 10 17:31:06.363555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-49e879bd-f2a9-4a34-bd17-92c0e9caedb8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Returning 404 to user: Instance 562c3b53-8ece-446c-951f-178341b686c4 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 17:31:06.363555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-49e879bd-f2a9-4a34-bd17-92c0e9caedb8 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4" status: 404 len: 111 microversion: 2.1 time: 0.029758 Aug 10 17:31:06.363555 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 603/1194] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 17:31:06 2022] GET /compute/v2.1/servers/562c3b53-8ece-446c-951f-178341b686c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 17:31:06.616820 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c61827a9-a586-4611-9810-52015ec8e630 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] Calling method '.version_select at 0x7f7eba0d74c0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 17:31:06.622127 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c61827a9-a586-4611-9810-52015ec8e630 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [1c42a410-0ee7-4a00-a99d-620898a785b9] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 17:31:07.630801 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO oslo.messaging._drivers.impl_rabbit [None req-c61827a9-a586-4611-9810-52015ec8e630 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] [1c42a410-0ee7-4a00-a99d-620898a785b9] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 46316. Aug 10 17:31:07.739413 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c61827a9-a586-4611-9810-52015ec8e630 tempest-TestShelveInstance-1670722098 tempest-TestShelveInstance-1670722098-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-721286479" status: 202 len: 0 microversion: 2.1 time: 1.126408 Aug 10 17:31:07.739999 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 592/1195] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 17:31:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-721286479 => generated 0 bytes in 1128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 17:32:45.277469 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:32:45.278060 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Wed Aug 10 17:32:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:32:51.007373 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:32:51.007980 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Wed Aug 10 17:32:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:32:51.924949 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:32:51.925488 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Wed Aug 10 17:32:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:36:05.285905 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:36:05.286987 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Wed Aug 10 17:36:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:36:11.015435 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:36:11.016021 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Wed Aug 10 17:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:36:11.933826 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:36:11.934542 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Wed Aug 10 17:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:36:14.704678 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:36:14.705299 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Wed Aug 10 17:36:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:36:29.723968 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:36:29.724672 dv-cinder-852724-3-iscsi devstack@n-api.service[121232]: Wed Aug 10 17:36:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 17:36:29.757302 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 17:36:29.757898 dv-cinder-852724-3-iscsi devstack@n-api.service[121231]: Wed Aug 10 17:36:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!